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Preface 



It has long been the established policy of CRC Press to publish, in handbook form, 
the most up-to-date, authoritative, logically arranged, and readily usable reference 
material available. Prior to the preparation of this 31 st Edition of the CRC Standard 
Mathematical Tables and Formulae, the content of such a book was reconsidered. 
The previous edition was carefully analyzed, and input was obtained from practi- 
tioners in the many branches of mathematics, engineering, and the physical sciences. 
The consensus was that numerous small additions were required in several sections, 
and several new areas needed to be added. 

Some of the new materials included in this edition are: game theory and voting 
power, heuristic search techniques, quadratic elds, reliability, risk analysis and de- 
cision rules, a table of solutions to Pell's equation, a table of irreducible polynomials 
in Zi\x\, a longer table of prime numbers, an interpretation of powers of 10, a col- 
lection of "proofs without words", and representations of groups of small order. In 
total, there are more than 30 completely new sections, more than 50 new and mod- 
i ed entries in the sections, more than 90 distinguished examples, and more than a 
dozen new tables and gures. This brings the total number of sections, sub-sections, 
and sub-sub-sections to more than 1,000. Within those sections are now more than 
3,000 separate items (a de nition , a fact, a table, or a property). The index has also 
been extensively re-worked and expanded to make nding results faster and easier; 
there are now more than 6,500 index references (with 75 cross-references of terms) 
and more than 750 notation references. 

The same successful format which has characterized earlier editions of the Hand- 
book is retained, while its presentation has been updated and made more consistent 
from page to page. Material is presented in a multi-sectional format, with each sec- 
tion containing a valuable collection of fundamental reference material — tabular and 
expository. 

In line with the established policy of CRC Press, the Handbook will be kept as 
current and timely as is possible. Revisions and anticipated uses of newer materials 
and tables will be introduced as the need arises. Suggestions for the inclusion of new 
material in subsequent editions and comments regarding the present edition are wel- 
comed. The home page for this book, which will include errata, will be maintained 

at htttpp(/Vy(OTti&htotteQitm^.. c om 

The major material in this new edition is as follows: 

Chapter 1: Analysis begins with numbers and then combines them into series and 
products. Series lead naturally into Fourier series. Numbers also lead to func- 
tions which results in coverage of real analysis, complex analysis, and gener- 
alized functions. 

Chapter 2: Algebra covers the different types of algebra studied: elementary al- 
gebra, vector algebra, linear algebra, and abstract algebra. Also included are 
details on polynomials and a separate section on number theory. This chapter 
includes many new tables. 

Chapter 3: Discrete Mathematics covers traditional discrete topics such as combi- 
natorics, graph theory, coding theory and information theory, operations re- 
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search, and game theory. Also included in this chapter are logic, set theory, 
and chaos. 

Chapter 4: Geometry covers all aspects of geometry: points, lines, planes, sur- 
faces, polyhedra, coordinate systems, and differential geometry. 

Chapter 5: Continuous Mathematics covers calculus material: differentiation, in- 
tegration, differential and integral equations, and tensor analysis. A large table 
of integrals is included. This chapter also includes differential forms and or- 
thogonal coordinate systems. 

Chapter 6: Special Functions contains a sequence of functions starting with the 
trigonometric, exponential, and hyperbolic functions, and leading to many of 
the common functions encountered in applications: orthogonal polynomials, 
gamma and beta functions, hypergeometric functions, Bessel and elliptic func- 
tions, and several others. This chapter also contains sections on Fourier and 
Laplace transforms, and includes tables of these transforms. 

Chapter 7: Probability and Statistics begins with basic probability information (de n - 
ing several common distributions) and leads to common statistical needs (point 
estimates, con d ence intervals, hypothesis testing, and ANOVA). Tables of the 
normal distribution, and other distributions, are included. Also included in this 
chapter are queuing theory, Markov chains, and random number generation. 

Chapter 8: Scientific Computing explores numerical solutions of linear and non- 
linear algebraic systems, numerical algorithms for linear algebra, and how to 
numerically solve ordinary and partial differential equations. 

Chapter 9: Financial Analysis contains the formulae needed to determine the re- 
turn on an investment and how to determine an annuity (i.e., the cost of a 
mortgage). Numerical tables covering common values are included. 

Chapter 10: Miscellaneous contains details on physical units (de nition s and con- 
versions), formulae for date computations, lists of mathematical and electronic 
resources, and biographies of famous mathematicians. 

It has been exciting updating this edition and making it as useful as possible. 
But it would not have been possible without the loving support of my family, Janet 
Taylor and Kent Taylor Zwillinger. 

Daniel Zwillinger 

zwillinger@alum.mit . edu 
15 October 2002 
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1.1 CONSTANTS 



1 .1 .1 TYPES OF NUMBERS 

1.1.1.1 Natural numbers 

The set of natural numbers, {0,1,2,.. .}, is customarily denoted by N. Many authors 
do not consider to be a natural number. 

1.1.1.2 Integers 

The set of integers, {0, ±1, ±2, . . .}, is customarily denoted by Z. The positive 
integers are {1, 2,3,.. .}. 

1.1.1.3 Rational numbers 

The set of rational numbers, {| | p,q G Z,q ^ 0}, is customarily denoted by Q. 
Two fractions | and ^ are equal if and only if ps = qr. 

Addition of fractions is de ned by | + L g = ps ^ r ■ Multiplication of fractions 
isdened by f • § = ff. 

1.1.1.4 Real numbers 

The set of real numbers is customarily denoted by E. Real numbers are de ned to 
be converging sequences of rational numbers or as decimals that might or might not 
repeat. 

Real numbers are often divided into two subsets. One subset, the algebraic 
numbers, are real numbers which solve a polynomial equation in one variable with 
integer coef cien ts. For example; is an algebraic number because it solves the 
polynomial equation 2a; 2 — 1 = 0; and all rational numbers are algebraic. Real num- 
bers that are not algebraic numbers are called transcendental numbers. Examples of 
transcendental numbers include 7r and e. 

1 .1 .1 .5 Complex numbers 

The set of complex numbers is customarily denoted by C. They are numbers of the 
form a + bi, where i 2 = — 1, and a and b are real numbers. See page 53. 

Operation computation result 

( a + c) + i{b + d) 
(ac — bd) + (ad + bc)i 
a b 

a 2 + b 2 ~ a 2 + b 2 1 
z = a — bi 

Properties include: z + w = z + w and zw = zw. 
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addition 
multiplication 

reciprocal 
complex conjugate 



(a + bi) + (c + di) 
(a + bi)(c + di) 
1 

a + bi 
z = a + bi 



1.1.2 ROMAN NUMERALS 

The major symbols in Roman numerals are I = 1, V = 5, X = 10, L = 50, C = 100, 
D = 500, and M = 1,000. The rules for constructing Roman numerals are: 

1 . A symbol following one of equal or greater value adds its value. (For example, 
II = 2, XI = 11, and DV = 505.) 

2. A symbol following one of lesser value has the lesser value subtracted from 
the larger value. An I is only allowed to precede a V or an X, an X is only 
allowed to precede an L or a C, and a C is only allowed to precede a D or 
an M. (For example IV = 4, IX = 9, and XL = 40.) 

3. When a symbol stands between two of greater value, its value is subtracted 
from the second and the result is added to the rst (for example, XIV= 10 + 
(5 - 1) = 14, CIX= 100 + (10 - 1) = 109, DXL= 500 + (50 - 10) = 540). 

4. When two ways exist for representing a number, the one in which the symbol 
of larger value occurs earlier in the string is preferred. (For example, 14 is 
represented as XIV, not as VIX.) 

Decimal number 1234567 8 9 
Roman numeral I II III IV V VI VII VIII IX 

10 14 50 200 400 500 600 999 1000 
X XIV L CC CD D DC CMXCIX M 

1950 1960 1970 1980 1990 

MCML MCMLX MCMLXX MCMLXXX MCMXC 

1995 1999 2000 2001 2004 2010 

MCMXCV MCMXCIX MM MMI MMIV MMX 

1.1.3 ARROW NOTATION 

Arrow notation is a way to represent large numbers in which evaluation proceeds 
from the right: 

m^n = m ■ m- ■ ■ to 

n 

to ft n = m t m t • • • t to 

> — I 1 1 — - (1.1.1) 

n 

Til ttt n = m tt tn tt ' ' ' tt m 



For example, mfn = to™, to tt 2 = to™, and to tt 3 = to/" 1 ™'. 
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1 .1 .4 REPRESENTATION OF NUMBERS 



Numerals as usually written have radix or base 10, so that the numeral a„a„-i . . . a\ ao 
represents the number a n 10" + a„_ilO n_1 + • • • + a^lO 2 + ailO + ao- However, 
other bases can be used, particularly bases 2, 8, and 16. When a number is written in 
base 2, the number is said to be in binary notation. The names of other bases are: 



2 binary 9 nonary 

3 ternary 10 decimal 

4 quaternary 11 undenary 

5 quinary 12 duodecimal 

6 senary 16 hexadecimal 

7 septenary 20 vigesimal 

8 octal 60 sexagesimal 

When writing a number in base b, the digits used range from to b — 1. If 
b > 10, then the digit A stands for 10, B for 11, etc. When a base other than 10 is 
used, it is indicated by a subscript: 

10111 2 = 1 x 2 4 + x 2 3 + 1 x 2 2 + 1 x 2 + 1 = 23, 
A3 i6 = 10 x 16 + 3 = 163, (1.1.2) 
543 7 = 5 x 7 2 + 4 x 7 + 3 = 276. 

To convert a number from base 10 to base b, divide the number by b, and the 
remainder will be the last digit. Then divide the quotient by b, using the remainder 
as the previous digit. Continue dividing the quotient by b until a quotient of is 
arrived at. 

EXAMPLE To convert 573 to base 12, divide 573 by 12, yielding a quotient of 47 and a 
remainder of 9; hence, "9" is the last digit. Divide 47 by 12, yielding a quotient of 3 and 
a remainder of 1 1 (which we represent with a "B"). Divide 3 by 12 yielding a quotient 
of and a remainder of 3. Therefore, 573io = 3B9i2- 

In general, to convert from base b to base r, it is simplest to convert to base 10 
as an intermediate step. However, it is simple to convert from base b to base b n . For 
example, to convert IIOIIIIOI2 to base 16, group the digits in fours (because 16 
is 2 4 ), yielding 1 1011 IIOI2, and then convert each group of 4 to base 16 directly, 
yielding 1BDi 6 . 
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1.1.5 BINARY PREFIXES 

A byte is 8 bits. A kibibyte is 2 10 = 1024 bytes. Other pre x es for power of 2 are: 



Factor 


Pre x 


Symbol 


2 io 


kibi 


Ki 


2 20 


mebi 


Mi 


2 30 


gibi 


Gi 


2 40 


tebi 


Ti 


2 50 


pebi 


Pi 


2 60 


exbi 


Ei 



1 .1 .6 DECIMAL MULTIPLES AND PREFIXES 

The pre x names and symbols below are taken from Conference Generale des Poids 
et Mesures, 1991. The common names are for the U.S. 



Factor 


Pre x 


Svmbol 


Common name 


10 (io 100 ) 






googolplex 


10 ioo 






googol 


10 24 


yotta 


Y 


heptillion 


10 21 


zetta 


Z 


hexillion 


10 18 


exa 


E 


quintillion 


10 15 


peta 


P 


quadrillion 


10 12 


tera 


T 


trillion 


10 9 


giga 


G 


billion 


10 6 


mega 


M 


million 


10 3 


kilo 


k 


thousand 


10 2 


hecto 


H 


hundred 


10 1 


deka 


da 


ten 


10" 1 


deci 


d 


tenth 


lO" 2 


centi 


c 


hundreth 


10" 3 


milli 


m 


thousandth 


10" 6 


micro 


[i (Greek mu) 


millionth 


lO" 9 


nano 


n 


billionth 


lO" 12 


pico 


P 


trillionth 


lO" 15 


femto 


f 


quadrillionth 


TO" 18 


atto 


a 


quintillionth 


lO" 21 


zepto 


z 


hexillionth 


1Q -24 


yocto 


y 


heptillionth 
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1 .1 .7 DECIMAL EQUIVALENTS OF COMMON FRACTIONS 







1/64 


0.015625 




1/32 


2/64 








3/64 


0.046875 


1/16 


2/32 


4/64 


0.0625 






5/64 


U.U/olzD 




3/32 


6/64 


0.09375 






7/64 


0.109375 


1/8 


A W1 

4/32 


8/64 


0.125 






9/64 


0.140625 




5/32 


10/64 


0.15625 






11/64 


0.171875 


3/16 


6/32 


12/64 


0.1875 






13/64 


0.203125 




7/32 


14/64 


0.21875 






15/64 


0.234375 


1/4 


8/32 


16/64 


0.25 






17/64 


0.265625 




9/32 


18/64 


0.28125 






19/64 


0.296875 


5/16 


10/32 


20/64 


0.3125 






21/64 


0.328125 




11/32 


22/64 


0.34375 






23/64 


0.359375 


3/8 


12/32 


24/64 


0.375 






25/64 


0.390625 




13/32 


26/64 


0.40625 






27/64 


0.421875 


7/16 


14/32 


28/64 


0.4375 






29/64 


0.453125 




15/32 


30/64 


0.46875 






31/64 


0.484375 


1/2 


16/32 


32/64 


0.5 







33/64 


0.515625 




17/32 


34/64 


0.53125 






35/64 


0.546875 


9/16 


18/32 


36/64 


0.5625 






37/64 


0.578125 




19/32 


38/64 


0.59375 






39/64 


0.609375 


5/8 


20/32 


40/64 


0.625 






41/64 


0.640625 




21/32 


42/64 


0.65625 






43/64 


0.671875 


11/16 


22/32 


44/64 


0.6875 






45/64 


0.703125 




23/32 


46/64 


0.71875 






47/64 


0.734375 


3/4 


24/32 


48/64 


0.75 






49/64 


0.765625 




25/32 


50/64 


0.78125 






51/64 


0.796875 


13/16 


26/32 


52/64 


0.8125 






53/64 


0.828125 




27/32 


54/64 


0.84375 






55/64 


0.859375 


7/8 


28/32 


56/64 


0.875 






57/64 


0.890625 




29/32 


58/64 


0.90625 






59/64 


0.921875 


15/16 


30/32 


60/64 


0.9375 






61/64 


0.953125 




31/32 


62/64 


0.96875 






63/64 


0.984375 


1/1 


32/32 


64/64 


1 
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1 .1 .8 HEXADECIMAL ADDITION AND SUBTRACTION TABLE 



A = 10, B = 11, C = 12, D = 13, E = 14, F = 15. 
Example: 6 + 2 = 8; hence 8 - 6 = 2 and 8 - 2 = 6. 
Example: 4 + E = 12; hence 12 - 4 = E and 12 - E = 4. 





1 


2 


3 


4 


5 


6 


7 


8 


9 


A 


B 


C 


D 


E 


F 


1 


02 


03 


04 


05 


06 


07 


08 


09 


OA 


OB 


OC 


OD 


OE 


OF 


10 


2 


03 


04 


05 


06 


07 


08 


09 


OA 


OB 


OC 


OD 


OE 


OF 


10 


11 


3 


04 


05 


06 


07 


08 


09 


OA 


OB 


OC 


OD 


OE 


OF 


10 


11 


12 


4 


05 


06 


07 


08 


09 


OA 


OB 


OC 


OD 


OE 


OF 


10 


11 


12 


13 


5 


06 


07 


08 


09 


OA 


OB 


OC 


OD 


OE 


OF 


10 


11 


12 


13 


14 


6 


07 


08 


09 


OA 


OB 


OC 


OD 


OE 


OF 


10 


11 


12 


13 


14 


15 


7 


08 


09 


OA 


OB 


OC 


OD 


OE 


OF 


10 


11 


12 


13 


14 


15 


16 


8 


09 


OA 


OB 


OC 


OD 


OE 


OF 


10 


11 


12 


13 


14 


15 


16 


17 


9 


OA 


OB 


OC 


OD 


OE 


OF 


10 


11 


12 


13 


14 


15 


16 


17 


18 


A 


OB 


OC 


OD 


OE 


OF 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


B 


OC 


OD 


OE 


OF 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


1A 


C 


OD 


OE 


OF 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


1A 


IB 


D 


OE 


OF 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


1A 


IB 


1C 


E 


OF 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


1A 


IB 


1C 


ID 


F 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


1A 


IB 


1C 


ID 


IE 



1 .1 .9 HEXADECIMAL MULTIPLICATION TABLE 



Example: 2x4 = 8. 
Example: 2 x F = IE. 





1 


2 


3 


4 


5 


6 


7 


8 


9 


A 


B 


C 


D 


E 


F 


1 


01 


02 


03 


04 


05 


06 


07 


08 


09 


OA 


OB 


OC 


OD 


OE 


OF 


2 


02 


04 


06 


08 


OA 


OC 


OE 


10 


12 


14 


16 


18 


1A 


1C 


IE 


3 


03 


06 


09 


OC 


OF 


12 


15 


18 


IB 


IE 


21 


24 


27 


2A 


2D 


4 


04 


08 


OC 


10 


14 


18 


1C 


20 


24 


28 


2C 


30 


34 


38 


3C 


5 


05 


OA 


OF 


14 


19 


IE 


23 


28 


2D 


32 


37 


3C 


41 


46 


4B 


6 


06 


OC 


12 


18 


IE 


24 


2A 


30 


36 


3C 


42 


48 


4E 


54 


5A 


7 


07 


OE 


15 


1C 


23 


2A 


31 


38 


3F 


46 


4D 


54 


5B 


62 


69 


8 


08 


10 


18 


20 


28 


30 


38 


40 


48 


50 


58 


60 


68 


70 


78 


9 


09 


12 


IB 


24 


2D 


36 


3F 


48 


51 


5A 


63 


6C 


75 


7E 


87 


A 


OA 


14 


IE 


28 


32 


3C 


46 


50 


5A 


64 


6E 


78 


82 


8C 


96 


B 


OB 


16 


21 


2C 


37 


42 


4D 


58 


63 


6E 


79 


84 


8F 


9A 


A5 


C 


OC 


18 


24 


30 


3C 


48 


54 


60 


6C 


78 


84 


90 


9C 


A8 


B4 


D 


OD 


1A 


27 


34 


41 


4E 


5B 


68 


75 


82 


8F 


9C 


A9 


B6 


C3 


E 


OE 


1C 


2A 


38 


46 


54 


62 


70 


7E 


8C 


9A 


A8 


B6 


C4 


D2 


F 


OF 


IE 


2D 


3C 


4B 


5A 


69 


78 


87 


96 


A5 


B4 


C3 


D2 


El 
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1.1.10 HEXADECIMAL-DECIMAL FRACTION CONVERSION 
TABLE 

The values below are correct to all digits shown. 



Hex 


Decimal 


Hex 


Decimal 


Hex 


Decimal 


Hex 


Decimal 


.00 





.40 


0.250000 


.80 


0.500000 


.CO 


0.750000 


.01 


0.003906 


.41 


0.253906 


.81 


0.503906 


.CI 


0.753906 


.02 


0.007812 


.42 


0.257812 


.82 


0.507812 


.C2 


0.757812 


.03 


0.011718 


.43 


0.261718 


.83 


0.511718 


.C3 


0.761718 


.04 


0.015625 


.44 


0.265625 


.84 


0.515625 


.C4 


0.765625 


.05 


0.019531 


.45 


0.269531 


.85 


0.519531 


.C5 


0.769531 


aa 
.00 


a aoq /m 
0.02343 / 


A A 

.40 


(J. 2/343 / 


OA 

.60 


A CT] A in 

0.52343 / 


/"'A 

.Co 


U. / /343 / 


.07 


0.027343 


.47 


A OIT) A 1 

0.277343 


.87 


A COT! A 1 

0.527343 


.CI 


A T7T5 A 1 

0.777343 


AO 

.08 


0.031250 


A O 

.48 


A lO 1 OCA 

0.2sl250 


oo 

.88 


ACTIO CA 

0.531250 


.C8 


A "70 1 OCA 

0.781250 


.09 


0.035 1 jo 


a n 

.4y 


U.2o5 1 JO 


OA 

.69 


0. j3j 1 jo 


r^n 
.C9 


A TOC 1 C/i 
U. / o5 1 JO 


.OA 


A AOAA^TO 

0.039062 


.4A 


0.289062 


.8A 


0.539062 


.CA 


0.789062 


.0B 


0.042968 


ATi 

.4B 


0.292968 


OTD 

.8B 


0.542968 


.CB 


A OAOAAO 

0.792968 


.OC 


a A/i 

0.0406/ J 


.4C 


o.zyos /5 


.8C 


0.5406 /5 




A "7AAOOC 

o. /yo8 /5 


.od 


a nemo i 

0.050781 


AT\ 

AD 


a i nm o 1 

0.300781 


on 

.8D 


a com o 1 

0.550781 


.CD 


A onmo i 

0.800781 


.On 


A AC A ACT" 

0.05408 / 


AU 

Ah 


A Q A/1 AOT" 
U. 30406 / 


.8b 


A CC A AOO" 

U. 55406 / 


.l_rl 


A OA/1 AOO 
0.60406 / 


.Or 


a acocaq 
0.056593 


AU 

At 


A 1 AO C AQ 

0.306593 


or 

.or 


a c?ocni 
0.558593 


.Cr 


A O AO c m 

0.606593 


.10 


0.062500 


.50 


0.312500 


.90 


0.562500 


.DO 


0.812500 


.11 


0.066406 


.51 


0.316406 


.91 


0.566406 


.Dl 


0.816406 


.12 


0.070312 


.52 


0.320312 


.92 


0.570312 


.D2 


0.820312 


.13 


0.074218 


.53 


0.324218 


.93 


0.574218 


.D3 


0.824218 


.14 


0.078125 


.54 


0.328125 


.94 


0.578125 


.D4 


0.828125 


.15 


0.082031 


.55 


0.332031 


.95 


0.582031 


.D5 


0.832031 


.16 


A AO c fin 

0.085937 


.56 


A IT C AT7 

0.335937 


.96 


A C O C A T7 

0.585937 


.D6 


A Ol C AT7 

0.835937 


.1 / 


0.069643 


.5 / 


A QQ AO /I Q 

0.339643 


.9 / 


A CO AO A 1 

0.589643 


.D 1 


A OO AO A Q 

0.839843 


1 O 

.Is 


A AAITCA 

0.093750 


.58 


A 1 /I 1"7CA 

0.343750 


AO 

.98 


a caioca 

0.593750 


.D8 


A o A n C A 

0.843750 


1 A 

.19 


o.oy /o5o 


.5y 


A Q /I OAC A 

0.34/050 


AA 

.99 


A CAT AC A 

0.59 /o5o 


T^A 

.uy 


A O A OA C A 

0.84 /o5o 


1 A 


A 1 A 1 C AO 

0.1015OZ 


C A 

.5A 


n Qrir AO 

0.35150Z 


A A 

.9 A 


A AA 1 C AO 

0.00150Z 


a 

.DA 


A OC 1 C AO 

0.851502 


1 D 

.IB 


0.105468 


.5B 


0.355468 


ATD 

.9B 


A A AC A A O 

0.605468 


.DB 


A O C C A A O 

0.855468 


.1C 


A 1 AAOOC 

0.109375 


.5C 


0.359375 


A/ -1 

.9C 


a A Anne 

0.609375 


.DC 


A ocaooc 

0.859375 


.ID 


1 1^?S1 


5n 

.JAJ 








.DD 


U.OUjiO 1 


.IE 


0.117187 


.5E 


0.367187 


.9E 


0.617187 


.DE 


0.867187 


.IF 


0.121093 


.5F 


0.371093 


.9F 


0.621093 


.DF 


0.871093 


.20 


0.125000 


.60 


0.375000 


AO 


0.625000 


.E0 


0.875000 


.21 


0.128906 


.61 


0.378906 


Al 


0.628906 


.El 


0.878906 


.22 


0.132812 


.62 


0.382812 


A2 


0.632812 


.E2 


0.882812 


.23 


0.136718 


.63 


0.386718 


A3 


0.636718 


.E3 


0.886718 


.24 


0.140625 


.64 


0.390625 


A4 


0.640625 


.E4 


0.890625 


.25 


0.144531 


.65 


0.394531 


A5 


0.644531 


,E5 


0.894531 


.26 


0.148437 


.66 


0.398437 


A6 


0.648437 


.E6 


0.898437 


.27 


0.152343 


.67 


0.402343 


A7 


0.652343 


.E7 


0.902343 
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Hex 


Decimal 


Hex 


Decimal 


Hex 


Decimal 


Hex 


Decimal 


.28 


0.156250 


.68 


0.406250 


.A8 


0.656250 


.E8 


0.906250 


.29 


0.160156 


.69 


0.410156 


A9 


0.660156 


.E9 


0.910156 


.2A 


0.164062 


.6A 


0.414062 


AA 


0.664062 


.EA 


0.914062 


OR 
.ZD 


U. ID /yOo 


AR 


n a i 


A R 
.Ad 


U.OD / VOo 


CD 
.HD 


n qi 7Q£o 


.2C 


0.171875 


.6C 


0.421875 


AC 


0.671875 


.EC 


0.921875 


.2D 


0.175781 


.6D 


0.425781 


AD 


0.675781 


.ED 


0.925781 


.2E 


0.179687 


.6E 


0.429687 


AE 


0.679687 


.EE 


0.929687 


.2F 


0.183593 


.6F 


0.433593 


AF 


0.683593 


.EF 


0.933593 


.30 


0.187500 


.70 


0.437500 


.BO 


0.687500 


.F0 


0.937500 


.31 


0.191406 


.71 


0.441406 


.Bl 


0.691406 


.Fl 


0.941406 


.32 


0.195312 


.72 


0.445312 


.B2 


0.695312 


.F2 


0.945312 


.33 


0.199218 


.73 


0.449218 


,B3 


0.699218 


.F3 


0.949218 


.34 


0.203125 


.74 


0.453125 


,B4 


0.703125 


.F4 


0.953125 


.35 


0.207031 


.75 


0.457031 


,B5 


0.707031 


.F5 


0.957031 


.36 


0.210937 


.76 


0.460937 


.B6 


0.710937 


.F6 


0.960937 


.37 


0.214843 


.77 


0.464843 


.B7 


0.714843 


.F7 


0.964843 


.38 


0.218750 


.78 


0.468750 


,B8 


0.718750 


.F8 


0.968750 


.39 


0.222656 


.79 


0.472656 


.B9 


0.722656 


.F9 


0.972656 


.3A 


0.226562 


JA 


0.476562 


.BA 


0.726562 


.FA 


0.976562 


"2R 

.3d 


U. 230408 


TR 
. ID 


U.4S0408 


RR 
.DD 


0. /3U46S 


IT) 


U.ys04O8 


.3C 


0.234375 


JC 


0.484375 


.BC 


0.734375 


.FC 


0.984375 


.3D 


0.238281 


.7D 


0.488281 


.BD 


0.738281 


.FD 


0.988281 


.3E 


0.242187 


.7E 


0.492187 


.BE 


0.742187 


.FE 


0.992187 


.3F 


0.246093 


.7F 


0.496093 


.BF 


0.746093 


.FF 


0.996093 



1.2 SPECIAL NUMBERS 



1.2.1 POWERS OF 2 



n 


2™ 


2 -n 


1 


2 


0.5 


2 


4 


0.25 


3 


8 


0.125 


4 


16 


0.0625 


5 


32 


0.03125 


6 


64 


0.015625 


7 


128 


0.0078125 


8 


256 


0.00390625 


9 


512 


0.001953125 


10 


1024 


0.0009765625 
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71 


2™ 


2 -n 


11 


2048 


0.00048828125 


12 


4096 


0.000244140625 


13 


8192 


0.0001220703125 


14 


16384 


00006103515625 


15 


32768 


000030517578125 

V / - V / V / V./ V./ / V7^7 1 1 *J 1 \J ±. £j^J 


16 


65536 


0.0000 1 525 87890625 


17 


131072 


0.00000762939453 125 


18 


262144 


000003814697265625 


19 


524288 


0000019073486328125 


20 


1048576 


00000095367431640625 


21 


2097152 


000000476837158203125 


22 


4194304 


0.0000002384185791015625 


23 


8388608 


00000011920928955078125 


24 


16777216 

J. \J III 4* J_ w 


000000059604644775390625 

V./ . V/ v / V / \y V/V/V/-.7 y \y\t \ \y I ri 1 ^' ~ ' s \y \y 


25 


33554432 


0.0000000298023223876953 125 


26 


67108864 


000000014901 161 19384765625 


27 


134217728 


0.0000000074505 80596923 828 1 25 


28 


268435456 


0000000037252902984619140625 


29 


536870912 


00000000186264514923095703125 


30 


1073741824 


000000000931322574615478515625 


31 


2147483648 


0.0000000004656612873077392578125 


32 


4294967296 


0.00000000023283064365386962890625 


33 


8589934592 


0.000000000116415321826934814453125 


34 


17179869184 


00000000005820766091 34674072265625 


35 


34359738368 


000000000029 1 038304567337036 1 328 1 25 


36 


68719476736 


0.0000000000 1455 19 1 522836685 1 806640625 


37 


137438953472 


0.0000000000072759576141834259033203125 


38 


274877906944 


0.00000000000363797 8 80709 1 7 1 295 1 660 1 5625 


39 


549755813888 


0.000000000001818989403545856475830078125 


40 


1099511627776 


0.0000000000009094947017729282379150390625 



n 


2 n 


n 


2™ 


41 


2199023255552 


42 


4398046511104 


43 


8796093022208 


44 


17592186044416 


45 


35184372088832 


46 


70368744177664 


47 


140737488355328 


48 


281474976710656 


49 


562949953421312 


50 


1125899906842624 


51 


2251799813685248 


52 


4503599627370496 


53 


9007199254740992 


54 


18014398509481984 


55 


36028797018963968 


56 


72057594037927936 


57 


144115188075855872 


58 


288230376151711744 


59 


576460752303423488 


60 


1152921504606846976 


61 


2305843009213693952 


62 


4611686018427387904 


63 


9223372036854775808 


64 


18446744073709551616 
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n 


2™ 


n 


2™ 


65 


36893488147419103232 


66 


73786976294838206464 


67 


147573952589676412928 


68 


295147905179352825856 


69 


590295810358705651712 


70 


1180591620717411303424 


71 


2361183241434822606848 


72 


47223664828696452 1 3696 


73 


9444732965739290427392 


74 


18889465931478580854784 


75 


37778931862957161709568 


76 


75557863725914323419136 


77 


1511 1 572745 1 828646838272 


78 


30223 1454903657293676544 


79 


6044629098073 14587353088 


80 


1208925819614629174706176 


81 


2417851639229258349412352 


82 


4835703278458516698824704 


83 


9671406556917033397649408 


84 


193428131 13834066795298816 


85 


38685626227668133590597632 


86 


77371252455336267181195264 


87 


154742504910672534362390528 


88 


309485009821345068724781056 


89 


6 1 89700 1 9642690 1 37449562 1 1 2 


90 


1237940039285380274899124224 



1 .2.2 POWERS OF 1 6 IN DECIMAL SCALE 



n 


16 n 


16" n 





1 


1 






1 


16 


0.0625 






2 


256 


0.00390625 






3 


4096 


0.000244140625 






4 


65536 


0.0000152587890625 






5 


1048576 


0.00000095367431640625 






6 


16777216 


0.000000059604644775390625 






7 


268435456 


0.00000000372529029846 1 9 140625 






8 


4294967296 


0.00000000023283064365386962890625 






9 


68719476736 


0.00000000001455 1 9 1 522836685 1 806640625 




10 


1099511627776 


0.0000000000009094947017729282379150390625 


11 


17592186044416 


5.684341886080801486968994140625 x 


lO" 14 




12 


281474976710656 


3.552713678800500929355621337890 • • 


• x 10" 


15 


13 


4503599627370496 


2.220446049250313080847263336181 • • 


• x 10" 


16 


14 


72057594037927936 


1.387778780781445675529539585113 • • 


• x 10" 


17 


15 


1152921504606846976 


8.673617379884035472059622406959 • • 


• x 10" 


19 


16 


18446744073709551616 


5.421010862427522170037264004349 • • 


• x 10" 


20 


17 


295147905179352825856 


3.388131789017201356273290002718 • • 


• x 10" 


21 


18 


4722366482869645213696 


2.117582368135750847670806251699 • • 


• x 10" 


22 


19 


75557863725914323419136 


1.323488980084844279794253907311 • • 


• x 10" 


23 


20 


1208925819614629174706176 


8.271806125530276748714086920699 • • 


• x 10" 


25 
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1.2.3 POWERS OF 10 IN HEXADECIMAL SCALE 



11 


10" 


10"" 





lie 


li 


c 




1 


Ale 





19999999999999999999. . . 16 


2 


64 le 





028F5C28F5C28F5C28F5. . 


•16 


3 


3E8i6 





004189374BC6A7EF9DB2. 


• -16 


4 


2710i6 





00068DB8BAC710CB295E 


■ -16 


5 


186A0i6 





0000A7C5AC471B478423. 


■16 


6 


F4240i 6 





000010C6F7A0B5ED8D36. 


• -16 


7 


989680 is 





000001AD7F29ABCAF485 


• -16 


8 


5F5E100i 6 





0000002AF31DC4611873. . 


■16 


9 


3B9ACA00i 6 





000000044B82FA09B5A5. . 


■16 


10 


2540BE400 i6 





000000006DF37F675EF6. . 


16 


11 


174876E800 16 





000000000AFEBFF0BCB2. 


■ -16 


12 


E8D4A51000i 6 





0000000001 197998 12DE. . . 


16 


13 


9184E72A000i 6 





0000000000 1C25C26849. . . 


16 


14 


5AF3107A4000i 6 





000000000002D09370D4. . . 


16 


15 


38D7EA4C68000i 6 





000000000000480EBE7B. . 


16 


16 


2386F26FC 10000 is 





0000000000000734ACA5. . 


16 



1.2.4 SPECIAL CONSTANTS 
1 .2.4.1 The constant n 

The transcendental number ir is de ned as the ratio of the circumference of a circle 
to the diameter. It is also the ratio of the area of a circle to the square of the radius 
(r) and appears in several formulae in geometry and trigonometry (see Section 6.1) 

4 , 

circumference of a circle = 27rr, volume of a sphere = -irr , 

3 

area of a circle = nr 2 , surface area of a sphere = Airr 2 . 

One method of computing 7r is to use the in nite series for the function tan _1 x and 
one of the identities 

7r = 4 tan -1 1 = 6 tan -1 — ^= 

= 2 tan" 1 - + 2 tan" 1 - + 8 tan" 1 - - 2 tan" 1 — 
2 3 5 239 

= 24 tan" 1 - + 8 tan" 1 — + 4 tan" 1 — 
8 57 239 

= 48 tan" 1 — + 32 tan" 1 — - 20 tan" 1 — 
18 57 239 



(1.2.1) 
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There are many other identities involving n. See Section 1.4.3. For example: 
^ If 4 2 1 1 



!=0 



16 8 \ 8i + 1 8i + 4 8« + 5 8i + 6 



7r = lim 

k— too 



*^2-^2+\^2 + ^ 



2 + V2 + V2+..- + V2 + V2 



& square roots 



A; square roots 



-=n 

7T - L - L 

fc=l 



2 + V2 + -- - + V2 + V2 



7T 

32 



(-1)' 



^ (2n + l) 3 



i-i + JL 

27 125 



1 

343 



+ 



(1.2.2) 



To 200 decimal places: 

7T SB 3. 



14159 26535 89793 23846 26433 83279 50288 41971 69399 37510 
58209 74944 59230 78164 06286 20899 86280 34825 34211 70679 
82148 08651 32823 06647 09384 46095 50582 23172 53594 08128 
48111 74502 84102 70193 85211 05559 64462 29489 54930 38196 
To 50 decimal places: 



7r/20 SB 





15707 


96326 


79489 


66192 


31321 


69163 


97514 


42098 


58469 


96876 


71-/15 SB 





20943 


95102 


39319 


54923 


08428 


92218 


63352 


56131 


44626 


62501 


7r/12 SB 





26179 


93877 


99149 


43653 


85536 


15273 


29190 


70164 


30783 


28126 


7r/ll SB 





28559 


93321 


44526 


65804 


20584 


89389 


04571 


67451 


97218 


12501 


Tt/10 SB 





31415 


92653 


58979 


32384 


62643 


38327 


95028 


84197 


16939 


93751 


7T/9 SB 





34906 


58503 


98865 


91538 


47381 


53697 


72254 


26885 


74377 


70835 


71-/8 SB 





39269 


90816 


98724 


15480 


78304 


22909 


93786 


05246 


46174 


92189 


71-/7 SB 





44879 


89505 


12827 


60549 


46633 


40468 


50041 


20281 


67057 


05359 


7I-/6 SB 





52359 


87755 


98298 


87307 


71072 


30546 


58381 


40328 


61566 


56252 


71-/5 SB 





62831 


85307 


17958 


64769 


25286 


76655 


90057 


68394 


33879 


87502 


71-/4 SB 





78539 


81633 


97448 


30961 


56608 


45819 


87572 


10492 


92349 


84378 


71-/3 SB 


1 


04719 


75511 


96597 


74615 


42144 


61093 


16762 


80657 


23133 


12504 


71-/2 SB 


1 


57079 


63267 


94896 


61923 


13216 


91639 


75144 


20985 


84699 


68755 


271-/3 SB 


2 


09439 


51023 


93195 


49230 


84289 


22186 


33525 


61314 


46266 


25007 


371-/2 SB 


4 


71238 


89803 


84689 


85769 


39650 


74919 


25432 


62957 


54099 


06266 
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5tt/2 ps 7.85398 16339 74483 09615 66084 58198 75721 04929 23498 43776 
ps 1.77245 38509 05516 02729 81674 83341 14518 27975 49456 12239 

In 1999 7T was computed to 206, 158,430, 208 = 3 • 2 36 decimal digits. The 
frequency distribution of the digits for tt — 3, up to 200,000,000,000 decimal places, 
is: 



digit 


20000030841 


digit 


5 


19999917053 


digit 1 


19999914711 


digit 


6 


19999881515 


digit 2 


20000136978 


digit 


7 


19999967594 


digit 3 


20000069393 


digit 


8 


20000291044 


digit 4 


19999921691 


digit 


9 


19999869180 



1 .2.4.2 The constant e 

The transcendental number e is the base of natural logarithms. It is given by 



/ 1\ " °° 1 
lim 1 + - =E-f < L2 - 3 > 



n->oo \ n / 1 — ' n 

To 200 decimal places: 

e « 2. 71828 18284 59045 23536 02874 71352 66249 77572 47093 69995 
95749 66967 62772 40766 30353 54759 45713 82178 52516 64274 
27466 39193 20030 59921 81741 35966 29043 57290 03342 95260 
59563 07381 32328 62794 34907 63233 82988 07531 95251 01901 

To 50 decimal places: 

e/8 ps 0.33978 52285 57380 65442 00359 33919 08281 22196 55886 71249 

e/7 ps 0.38832 59754 94149 31933 71839 24478 95178 53938 92441 95714 

e/6 ps 0.45304 69714 09840 87256 00479 11892 11041 62928 74515 61666 

e/5 ps 0.54365 63656 91809 04707 20574 94270 53249 95514 49418 73999 

e/4 ps 0.67957 04571 14761 30884 00718 67838 16562 44393 11773 42499 

e/3 ps 0.90609 39428 19681 74512 00958 23784 22083 25857 49031 23332 

e/2 ps 1.35914 09142 29522 61768 01437 35676 33124 88786 23546 84998 

2e/3 ps 1.81218 78856 39363 49024 01916 47568 44166 51714 98062 46664 

e" ps 23.14069 26327 79269 00572 90863 67948 54738 02661 06242 60021 

tt 6 ps 22.45915 77183 61045 47342 71522 04543 73502 75893 15133 99669 



The function e x is de ned by e x = N — - (see page 521). The numbers e and tt are 

^— ' n! 

n=0 



related by the formula 



(1.2.4) 



1 .2.4.3 The constant 7 

Euler's constant 7 is de ned by 

7 = lim logn ] . 

\k=\ / 
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It is not known whether 7 is rational or irrational. To 200 decimal places: 



7 j* 0. 57721 56649 01532 86060 65120 90082 40243 10421 59335 93992 
35988 05767 23488 48677 26777 66467 09369 47063 29174 67495 
14631 44724 98070 82480 96050 40144 86542 83622 41739 97644 
92353 62535 00333 74293 73377 37673 94279 25952 58247 09492 



1 .2.4.4 The constant <f> 

The golden ratio, <f>, is de ned as the positive root of the equation y = ; that 

is <f> = 1+ 2 v/ ^ . There is the continued fraction representation <j> = [Tl (see Section 
2.4.4) and the representation in square roots 



To 200 decimal places: 

<j> ps 1. 61803 39887 49894 84820 45868 34365 63811 77203 09179 80576 
28621 35448 62270 52604 62818 90244 97072 07204 18939 11374 
84754 08807 53868 91752 12663 38622 23536 93179 31800 60766 
72635 44333 89086 59593 95829 05638 32266 13199 28290 26788 

1.2.4.5 Other constants 



To 50 decimal places 



v/2« 


1 


41421 


35623 


73095 


04880 


16887 


24209 


69807 


85696 


71875 


37695 




1 


73205 


08075 


68877 


29352 


74463 


41505 


87236 


69428 


05253 


81038 




2 


23606 


79774 


99789 


69640 


91736 


68731 


27623 


54406 


18359 


61153 




2 


44948 


97427 


83178 


09819 


72840 


74705 


89139 


19659 


47480 


65667 




2 


64575 


13110 


64590 


59050 


16157 


53639 


26042 


57102 


59183 


08245 




2 


82842 


71247 


46190 


09760 


33774 


48419 


39615 


71393 


43750 


75390 


In 2 ps 





69314 


71805 


59945 


30941 


72321 


21458 


17656 


80755 


00134 


36026 


In 3 f« 


1 


09861 


22886 


68109 


69139 


52452 


36922 


52570 


46474 


90557 


82275 


In 5 ps 


1 


60943 


79124 


34100 


37460 


07593 


33226 


18763 


95256 


01354 


26852 


log 2 ps 





30102 


99956 


63981 


19521 


37388 


94724 


49302 


67681 


89881 


46211 


log 3 ps 





47712 


12547 


19662 


43729 


50279 


03255 


11530 


92001 


28864 


19070 


log 5 ps 





69897 


00043 


36018 


80478 


62611 


05275 


50697 


32318 


10118 


53789 



1 .2.5 CONSTANTS IN DIFFERENT BASES 



7T R 


i 11 


00100100001111110110101010001000100001011010001.. 


• 2 


e s 


i 10 


10110111111000010101000101100010100010101110110.. 


• 2 


1R 


i 


10010011110001000110011111100011011111011011000.. 


• 2 




i 1 


01101010000010011110011001100111111100111011110.. 


•2 


ln2R 


i 


10110001011100100001011111110111110100011100111.. 


■2 




Base 2 
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Base 8 



7T PS 


3 


11037552421026430215142306305056006701632112201. 


e ps 


2 


55760521305053551246527734254200471723636166134. 


7ps 





44742147706766606172232157437601002513132552071. 




1 


32404746317716746220426276611546725125751743533. 


ln2« 





54271027757507173632571170731630007713665364036. 



Base 12 



7T Si 


3 


184809493B918664573A6211BB151551A05729290A78. 


• 12 


e Si 


2 


8752360698219BA71971009B388AA876676025642727. 


• 12 


7ps 





6B15188A6760B381B754334520434A22560A590A6A5... 


12 




1 


4B79170A07B85737704B085486853504563650B559B8. 


• 12 


ln2« 





839912483369AB213742A34679253788658A1402A540. 


• 12 



Base 16 

7T ?s 3 . 243F6A8885A308D313198A2E03707344A4093822299F. . . 16 

e PS 2 . B7E15 1628AED2A6ABF7 158809CF4F3C762E7 160F3. . . 16 

7 PS . 93C467E37DB0C7A4D1BE3F810152CB56A1CECC3A.. . 16 

sj2 PS 1 . 6A09E667F3BCC908B2FB1366EA957D3E3ADEC175. . . i 6 

In 2 ~ 0.B17217F7DlCF79ABC9E3B39803F2F6AF40F3432672...i 6 



1.2.6 FACTORIALS 

For non-negative integers n, the factorial of n, denoted nl, is the product of all pos- 
itive integers less than or equal to n; nl = n ■ (n — 1) • (n — 2) • • • 2 • 1. If n is 
a negative integer (n = —1,-2,...) then nl = ±oc. Note that, since the empty 
product is 1, it follows that 0! = 1. The generalization of the factorial function to 
non-integer arguments is the gamma function (see page 540). When n is an integer, 
T(n) = (n - 1)!. 

The double factorial of n, denoted nil, is the product of every other integer: 
nil = n ■ (n — 2) • (n — 4) • • • , where the last element in the product is either 2 
or 1, depending on whether n is even or odd. The shifted factorial (also called the 
rising factorial and Pochhammer's symbol) is denoted by (a) „ (sometimes a") and 
is de ned as 

/ \ / , iw i .J- i\ (a + n -1)1 r(a + n) 

(a)„ = a ■ (a + 1) • (a + 2) • • • (a + n - 1) = — = — . (1.2.6) 

> „ (a-1)! T(a) 

n terms 

Approximations to n! for large n include Stirling's formula 

nlPSv^^J , (1.2.7) 

and Burnsides's formula 

n! PS 2. . (1.2.8) 
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n 


n\ 




lo£ 


;io™ ! 


nil 




log 


ion" 


o 


1 




o 


00000 


1 




o 


00000 


1 


1 




o 


00000 


1 




o 


00000 


2 


2 




o 


30103 


2 




o 


30103 


3 


6 




o 


77815 


3 




o 


47712 


4 


24 




1 


38021 


8 




o 


90309 


5 


120 




2 


07918 


15 




1 


17609 


6 


720 




2 


85733 


48 




1 


68124 


7 


5040 




3 


70243 


105 




2 


02119 


8 


40320 




4 


60552 


384 




2 


58433 


9 


3 6288 x 


10 5 


5 


55976 


945 




2 


97543 


10 


3.6288 x 


10 6 


6 


55976 


3840 




3 


58433 


11 


3.9917 x 


10 7 


7 


60116 


10395 




4 


01682 


12 


4 7900 x 


10 8 


8 


68034 


46080 




4 


66351 


13 


6.2270 x 


10 9 


g 


79428 


1.3514 x 


10 5 


5 


13077 


14 


8.7178 x 


10 10 


10 


94041 


6.4512 x 


10 5 


5 


80964 


15 


1.3077 x 


10 12 


12 


11650 


2.0270 x 


10 6 


6 


30686 


16 


2.0923 x 


10 13 


13 


32062 


1.0322 x 


10 7 


7 


01376 


17 


3 5569 x 


10 14 


14 


55107 


3.4459 x 


10 7 


7 


53731 


18 


6.4024 x 


10 15 


15 


80634 


1 8579 x 


10 8 


8 


26903 


19 


1.2165 x 


10 17 


17 


08509 


6 5473 x 


10 8 


8 


81606 


20 


2.4329 x 


10 18 


18 


38612 


3 7159 x 


10 9 


9 


57006 


21 


5.1091 x 


10 19 


19 


70834 


1.3749 x 


10 10 


10 


13828 


22 


1.1240 x 


10 21 


21 


05077 


8 1750 x 


10 10 


10 


91249 


23 


2.5852 x 


10 22 


22 


41249 


3.1623 x 


10 11 


11 


50001 


24 


6.2045 x 


10 23 


23 


79271 


1.9620 x 


10 12 


12 


29270 


25 


1.5511 x 


10 25 


25 


19065 


7 9059 x 


10 12 


12 


89795 


30 


2.6525 x 


10 32 


32 


42366 


4.2850 x 


10 16 


16 


63195 


40 


8.1592 x 


10 47 


47 


91165 


2.5511 x 


10 24 


24 


40672 


50 


3.0414 x 


10 64 


64 


48307 


5.2047 x 


10 32 


32 


71640 


60 


8.3210 x 


10 81 


81 


92017 


2.8481 x 


10 41 


41 


45456 


70 


1.1979 x 


10 100 


100 


07841 


3 5504 x 


10 50 


50 


55028 


80 


7 1569 x 


10 118 


118 


85473 


8.9711 x 


10 59 


59 


95284 


90 


1.4857 x 


10 138 


138 


17194 


4.2088 x 


10 69 


69 


62416 


100 


9 3326 x 


10 157 


157 


97000 


3.4243 x 


10 79 


79 


53457 


110 


1.5882 x 


10 178 


178 


20092 


4.5744 x 


10 89 


89 


66033 


120 


6 6895 x 


10 198 


198 


82539 


9 5934 x 


10" 


99 


98197 


130 


6.4669 x 


10 219 


219 


81069 


3.0428 x 


10 no 


110 


48328 


140 


1.3462 x 


10 241 


241 


12911 


1.4142 x 


10 121 


121 


15050 


150 


5.7134 x 


10 262 


262 


75689 


9.3726 x 


10 131 


131 


97186 


500 


1.2201 x 


10 1134 


1134.0864 


5.8490 x 


10 567 


567 


76709 


1000 


4.0239 x 


^0 2 567 


2567.6046 


3.9940 x 


10 1284 


1284.6014 
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1 .2.7 BERNOULLI POLYNOMIALS AND NUMBERS 

The Bernoulli polynomials B n (x) are de ned by the generating function 



te x 



1 



^7' 



(1.2.9) 



n=0 



These polynomials can also be de ned recursively by means of £? 0(2;) = 1, B' n (x) = 
nB n -i(x), and J B n (x)dx = Oforn > 1. The identity B k+ i(x + l) - B k+ i(x) = 
(k + l)x k means that sums of powers can be computed in terms of Bernoulli poly- 
nomials 

,* , , -* _ B*+i(n + l)--B*+i(0) 



k + 1 



(1.2.10) 



B„(x) 



1 

(2x- l)/2 
(6x 2 -6x+ l)/6 
(2a; 3 - 3a; 2 +x)/2 
(30x 4 - 60a; 3 + 30a; 2 - l)/30 
(6x 5 - 15a; 4 + 10a; 3 - x) /6 



The Bernoulli numbers are the Bernoulli polynomials evaluated at 0: B n 



B n (0). A generating function for the Bernoulli numbers is 7 B n — - 



n=0 



n! e* — 1 

In the following table each Bernoulli number is written as a fraction of integers: 
B n = N n /D n . Note that B 2m+ i = for m > 1. 



n 




D n 













1 


1.000000000 x 


10° 




1 




2 


-5.000000000 x 


10- 


1 


2 




6 


1.666666667 x 


10- 


1 


4 




30 


-3.333333333 x 


10- 


2 


6 




42 


2.380952381 x 


10- 


2 


8 




30 


-3.333333333 x 


10" 


2 


10 




66 


7.575757576 x 


10" 


2 


12 


-691 


2730 


-2.531135531 x 


10- 


1 


14 




6 


1.166666667 x 


10° 




16 


-3617 


510 


-7.092156863 x 


10° 




18 


43867 


798 


5.497117794 x 


10 1 




20 


-174611 


330 


-5.291242424 x 


10 2 




22 


854513 


138 


6.192123188 x 


10 3 




24 


-236364091 


2730 


-8.658025311 x 


10 4 




26 


8553103 


6 


1.425517167 x 


10 6 




28 


-23749461029 


870 


-2.729823107 x 


10 7 




30 


8615841276005 


14322 


6.015808739 x 


10 8 




32 


-7709321041217 


510 


-1.511631577 x 


10 10 


34 


2577687858367 


6 


4.296146431 x 


10 11 
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1 .2.8 EULER POLYNOMIALS AND NUMBERS 

The Euler polynomials E n (x) are de ned by the generating function 



2e x 



e* + 1 



00 
n=0 



(1.2.11) 



n 


E n (x) 





1 


1 


(2x- l)/2 


2 




3 


(4a; 3 -6a; 2 + l)/4 


4 


x A — 2x 3 + x 


5 


(2a; 5 -5a; 4 + 5a; 2 - l)/2 



Alternating sums of powers can be computed in terms of Euler polynomials 



(n-lf + -T2*± 1* 



S*(n + l) + (-l) n S*(0) 



i=l 



(1.2.12) 

The Euler numbers are the Euler polynomials evaluated at 1/2, and scaled: 
= 2 n E n {\). A generating function for the Euler numbers is 



^— ' rj.l 



2e* 



n=0 



e 2i + 1 



(1.2.13) 



2 
4 
6 
8 

10 
12 
14 
16 
18 
20 
22 
24 
26 
28 
30 
32 
34 
36 
38 
40 



E„ 



-1 

5 

-61 
1385 
-50521 
2702765 
-199360981 
19391512145 
-2404879675441 
370371188237525 
-69348874393137901 
15514534163557086905 
-4087072509293123892361 
1252259641403629865468285 
-441543893249023104553682821 
177519391579539289436664789665 
-80723299235887898062168247453281 
41222060339517702122347079671259045 
-23489580527043108252017828576198947741 
14851150718114980017877156781405826684425 
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1.2.9 FIBONACCI NUMBERS 

The Fibonacci numbers {F n } are de ned by the recurrence: 

F\ = 1, F-2 = 1, -Fn+2 = -^n + 

An exact formula is available: 



(1.2.14) 



F 



1 

7E 



'l + \/5 N 



1 - \/5 N 



(1.2.15) 



F 4.1 

Note that lim -£±i 



6, the golden ratio. Also, F n ~ c\) n j\fh as n — > oc . 



n 


F n 


n 


Fn 


n 


Fn 


n 


Fn 


1 


1 


14 


377 


27 


196418 


40 


102334155 


2 


1 


15 


610 


28 


317811 


41 


165580141 


3 


2 


16 


987 


29 


514229 


42 


267914296 


4 


3 


17 


1597 


30 


832040 


43 


433494437 


5 


5 


18 


2584 


31 


1346269 


44 


701408733 


6 


8 


19 


4181 


32 


2178309 


45 


1134903170 


7 


13 


20 


6765 


33 


3524578 


46 


1836311903 


8 


21 


21 


10946 


34 


5702887 


47 


2971215073 


9 


34 


22 


17711 


35 


9227465 


48 


4807526976 


10 


55 


23 


28657 


36 


14930352 


49 


7778742049 


11 


89 


24 


46368 


37 


24157817 


50 


12586269025 


12 


144 


25 


75025 


38 


39088169 


51 


20365011074 


13 


233 


26 


121393 


39 


63245986 


52 


32951280099 



1.2.10 POWERS OF INTEGERS 



n 


n 3 


n 4 


n 6 


n 6 


n 7 


n 8 


n 10 


1 


1 


1 


1 


1 


1 


1 


1 


2 


8 


16 


32 


64 


128 


256 


1024 


3 


27 


81 


243 


729 


2187 


6561 


59049 


4 


64 


256 


1024 


4096 


16384 


65536 


1048576 


5 


125 


625 


3125 


15625 


78125 


390625 


9765625 


6 


216 


1296 


7776 


46656 


279936 


1679616 


60466176 


7 


343 


2401 


16807 


117649 


823543 


5764801 


282475249 


8 


512 


4096 


32768 


262144 


2097152 


16777216 


1073741824 


9 


729 


6561 


59049 


531441 


4782969 


43046721 


3486784401 


10 


1000 


10000 


100000 


1000000 


10000000 


100000000 


10000000000 


11 


1331 


14641 


161051 


1771561 


19487171 


214358881 


25937424601 


12 


1728 


20736 


248832 


2985984 


35831808 


429981696 


61917364224 
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1 .2.1 1 SUMS OF POWERS OF INTEGERS 

1 . De ne 

n 

s k (n) = l k + 2 k H hn*= Y] m *- 

Properties include: 



m— 1 



(a) s k (n) = (k + l)" 1 + 1) " B *+i(0)] 

(where the are Bernoulli polynomials, see Section 1.2.7). 

(b) If 8k (n) = Y^li a m n k ~ m +\ then 



Sk+i(n) 



k + l 
k + 2 

+ ■■■ + 



am k+2 H h 



k + l 

k 



a 3 n 



k + 1 



a k+ in + 



k+l 



!-(* + !)£ 



(1.2.16) 



m— 1 



A; + 3 — to 



Sl (n) = 1 + 2 + 3 H hn = -n(n + 1) 

s 2 (n) = l 2 + 2 2 + 3 2 + • • • + n 2 = ^n(n + l)(2n + 1) 

s 3 (n) = l 3 + 2 3 + 3 3 + • • • + n 3 = Jn 2 (n + l) 2 = [si(n)] 2 

(c) a* (n) = l 4 + 2 4 + 3 4 + • • • + n 4 = -(3n 2 + 3n - lWn) 

5 

s s (n) = l 5 + 2 5 + 3 5 + • • • + n 5 = -^n 2 (n + l) 2 (2n 2 + 2n - 1) 
s 6 (n) = l 6 + 2 6 + 3 6 + ---+n 6 

= -^(n + l)(2n + l)(3n 4 + 6n 3 - 3n + 1). 



n 1 
2. YJ(A;to — 1) = -mn(n + 1) 



fc=i 



3. ^(fcm - l) 2 = ^ [m 2 (n + l)(2n + 1) - 6m(n + 1) + 6] 



A-=l 



4. YJ(£;to-1) 3 = ^ [m 3 n(n + l) 2 - 2m 2 (n + l)(2n + 1) + 6m(n + 1) - 4] 



5. ^(-l) ft+1 (fcm - 1) = i— i- [2 - (2n + l)m] + ^— 



fc=i 



6. YJ(-l)* +1 (fcm-l) 2 



(-1) 



n+l 



[n(ra + l)m 2 - (2n + l)m + l] + 



1 — TO 



fc=l 
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n 


E/fc=l k 






ELi k 4 


ELi k 5 


1 


1 


1 


i 


1 


1 


2 


3 


5 


9 


17 


33 


3 


6 


14 


36 


98 


276 


4 


10 


30 


100 


354 


1300 


5 


15 


55 


225 


979 


4425 


6 


21 


91 


441 


2275 


12201 


7 


28 


140 


784 


4676 


29008 


8 


36 


204 


1296 


8772 


61776 


9 


45 


285 


2025 


15333 


120825 


10 


55 


385 


3025 


25333 


220825 


11 


66 


506 


4356 


39974 


381876 


12 


78 


650 


6084 


60710 


630708 


13 


91 


819 


8281 


89271 


1002001 


14 


105 


1015 


11025 


127687 


1539825 


15 


120 


1240 


14400 


178312 


2299200 


16 


136 


1496 


18496 


243848 


3347776 


17 


153 


1785 


23409 


327369 


4767633 


18 


171 


2109 


29241 


432345 


6657201 


19 


190 


2470 


36100 


562666 


9133300 


20 


210 


2870 


44100 


722666 


12333300 


21 


231 


3311 


53361 


917147 


16417401 


22 


253 


3795 


64009 


1151403 


21571033 


23 


276 


4324 


76176 


1431244 


28007376 


24 


300 


4900 


90000 


1763020 


35970000 


25 


325 


5525 


105625 


2153645 


45735625 



1.2.12 NEGATIVE INTEGER POWERS 

Riemann's zeta function is ((n) = w ^ * s ^ e nec * ^ or R & k > 1 and extended 

to C). Related functions are 

°° 00 (-1)* °° 1 

Properties include: 

1. a(n) = (1 - 2'-")«n) 3. T (n) = (1 - 2"")C(n) 

2 '« = W I%I + d = 4^11^1 

5. The series /3(1) = 1 — | + | — ••• = 7r/4 is known as Gregory's series. 

6. Catalan's constant is G = 13(2) ?s 0.915966. 
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7. Riemann hypothesis: The non-trivial zeros of the Riemann zeta function (i.e., 
the {z{\ that satisfy C( z i) = 0) li e on me critical line given by Re Zi = \. 
(The trivial zeros are z = —2, —4, —6, . . . .) 



n 


<(») = Ef 


~ (_l)*+i 


» (_!)* 


co 1 


/ * fen 
k=i 


^(2* + !)" 




1 




OO 





6931471805 


0.7853981633 




oo 


9 


1 


6449340669 





8224670334 





9159655941 


1 


2337005501 


Q 
O 


1 


2020569032 





9015426773 





9689461463 


1 


0517997903 


A 


1 


0823232337 





9470328294 





9889445517 


1 


0146780316 


K 



1 


0369277551 





9721197705 





9961578281 


1 


0045237628 


D 


1 


0173430620 





9855510912 





9986852222 


1 


0014470766 


7 


1 


0083492774 





9925938199 





9995545079 


1 


0004715487 


a 
o 


1 


0040773562 





9962330018 





9998499902 


1 


0001551790 


Q 


1 


0020083928 





9980942975 





9999496842 


1 


0000513452 


i n 

1U 


1 


0009945752 





9990395075 





9999831640 


1 


0000170414 


1 1 
1 1 


1 


0004941886 





9995171435 





9999943749 


1 


0000056661 


12 


1 


0002460866 





9997576851 





9999981224 


1 


0000018858 


13 


1 


0001227133 





9998785428 





9999993736 


1 


0000006281 


14 


1 


0000612482 





9999391703 





9999997911 


1 


0000002092 


15 


1 


0000305882 





9999695512 





9999999303 


1 


0000000697 


16 


1 


0000152823 





9999847642 





9999999768 


1 


0000000232 


17 


1 


0000076372 





9999923783 





9999999923 


1 


0000000077 


18 


1 


0000038173 





9999961879 





9999999974 


1 


0000000026 


19 


1 


0000019082 





9999980935 





9999999991 


1 


0000000009 


20 


1 


0000009540 





9999990466 





9999999997 


1 


0000000003 



/3(1)=tt/4 
0(3) =tt 3 /32 
/3(5) = 5tt 5 /1536 
P(7) = 61tt 7 /184320 
P(9) = 277tt 9 /8257536 



C(2) = 7r 2 / 6 
C(4) = tt 4 /90 
((6) = tt 6 /945 
C(8) = tt 8 /9450 
C(10) =tt 10 /93555 



1.2.13 DEBRUIJN SEQUENCES 

A sequence of length q n over an alphabet of size q is a de Bruijn sequence if every 
possible n-tuple occurs in the sequence (allowing wraparound to the start of the 
sequence). There are de Bruijn sequences for any q and n. The table below gives 
some small examples. 



q 


n 


Length 


Sequence 


2 


1 


2 


01 


2 


2 


4 


0110 


2 


3 


8 


01110100 


2 


4 


16 


0101001101111000 


3 


2 


9 


001220211 


4 


2 


16 


0011310221203323 
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1.2.14 INTEGER SEQUENCES 

These sequences are arranged in numerical order (disregarding any leading zeros or 
ones). Note that C(n, k) = (£) ; see page 206. 

1. 1, -1, -1, 0, -1, 1, -1, 0, 0, 1, -1, 0, -1, 1, 1, 0, -1, 0, -1, 0, 1, 1, -1, 0, 0, 1, 0, 

0, -1, -1, -1, 0, 1, 1, 1, 0, -1, 1, 1, 0, -1, -1, -1, 0, 0, 1, -1, 0, 0, 0, 1, 0, -1, 0, 

1, Mobius function n(n),n > 1 

2. 1, 1, 0, 1, 1, 0, 0, 1, 1, 1, 0, 0, 1, 0, 0, 1, 1, 1, 0, 1, 0, 0, 0, 0, 2, 1, 0, 0, 1, 0, 0, 1, 0, 1, 

0, 1, 1, 0, 0, 1, 1, 0, 0, 0, 1, 0, 0, 0, 1, 2, 0, 1, 1, 0, 0, 0, 0, 1, 0, 0, 1, 0, 0, 1, 2, 0, 0, 1, 

Number of ways of writing n as a sum of 2 squares, n > 

3. 0, 1, 1, 1, 1, 2, 1, 1, 1, 2, 1, 2, 1, 2, 2, 1, 1, 2, 1, 2, 2, 2, 1, 2, 1, 2, 1, 2, 1, 3, 1, 1, 2, 2, 

2, 2, 1, 2, 2, 2, 1, 3, 1, 2, 2, 2, 1, 2, 1, 2, 2, 2, 1, 2, 2, 2, 2, 2, 1, 3, 1, 2, 2, 1, 2, 3, 1, 2, 
2 Number of distinct primes dividing n, n > 1 

4. 1, 1, 1, 2, 1, 1, 1, 3, 2, 1, 1, 2, 1, 1, 1, 5, 1, 2, 1, 2, 1, 1, 1, 3, 2, 1, 3, 2, 1, 1, 1, 7, 1, 1, 

1, 4, 1, 1, 1, 3, 1, 1, 1, 2, 2, 1, 1, 5, 2, 2, 1, 2, 1, 3, 1, 3, 1, 1, 1, 2, 1, 1, 2, 11, 1, 1, 1, 
2 Number of abelian groups of order n, n > 1 

5. 1, 1, 1, 2, 1, 2, 1, 5, 2, 2, 1, 5, 1, 2, 1, 14, 1, 5, 1, 5, 2, 2, 1, 15, 2, 2, 5, 4, 1, 4, 1, 51, 

1, 2, 1, 14, 1, 2, 2, 14, 1, 6, 1, 4, 2, 2, 1, 52, 2, 5, 1, 5, 1, 15, 2, 13, 2, 2, 1, 13, 1, 2, 4, 
267 Number of groups of order n, n > 1 

6. 0, 1, 1, 2, 1, 2, 2, 3, 1, 2, 2, 3, 2, 3, 3, 4, 1, 2, 2, 3, 2, 3, 3, 4, 2, 3, 3, 4, 3, 4, 4, 5, 1, 2, 

2, 3, 2, 3, 3, 4, 2, 3, 3, 4, 3, 4, 4, 5, 2, 3, 3, 4, 3, 4, 4, 5, 3, 4, 4, 5, 4, 5, 5, 6, 1, 2, 2, 3, 
2 Number of l's in binary expansion of n, n > 

7. 1, 2, 1, 2, 3, 6, 9, 18, 30, 56, 99, 186, 335, 630, 1161, 2182, 4080, 7710, 14532, 27594, 
52377, 99858, 190557, 364722, 698870, 1342176, 2580795, 4971008 

Number of binary irreducible polynomials of degree n, or n-bead necklaces, n > 

8. 1, 1, 1, 2, 1, 3, 1, 4, 2, 3, 1, 8, 1, 3, 3, 8, 1, 8, 1, 8, 3, 3, 1, 20, 2, 3, 4, 8, 1, 13, 1, 16, 3, 

3, 3, 26, 1, 3, 3, 20, 1, 13, 1, 8, 8, 3, 1, 48, 2, 8, 3, 8, 1, 20, 3, 20, 3, 3, 113 

Number of perfect partitions of n, or ordered factorizations of n + 1, n > 

9. 1, 2, 2, 1, 2, 1, 1, 2, 2, 1, 1, 2, 1, 2, 2, 1, 2, 1, 1, 2, 1, 2, 2, 1, 1, 2, 2, 1, 2, 1, 1, 2, 2, 1, 
1, 2, 1, 2, 2, 1, 1, 2, 2, 1, 2, 1, 1, 2, 1, 2, 2, 1, 2, 1, 1, 2, 2, 1, 1, 2, 1, 2, 2, 1, 2, 1, 1, 2, 

1 Thue-Morse non-repeating sequence 

10. 1, 2, 1, 4, 1, 2, 1, 8, 1, 2, 1, 4, 1, 2, 1, 9, 1, 2, 1, 4, 1, 2, 1, 8, 1, 2, 1, 4, 1, 2, 1, 10, 1, 2, 

I, 4, 1, 2, 1, 8, 1, 2, 1, 4, 1, 2, 1, 9, 1, 2, 1, 4, 1, 2, 1, 8, 1, 2, 1, 4, 1, 2, 1, 12, 1, 2, 1, 
4 Hurwitz-Radon numbers 

11. 1, 2, 2, 3, 2, 4, 2, 4, 3, 4, 2, 6, 2, 4, 4, 5, 2, 6, 2, 6, 4, 4, 2, 8, 3, 4, 4, 6, 2, 8, 2, 6, 4, 4, 

4, 9, 2, 4, 4, 8, 2, 8, 2, 6, 6, 4, 2, 10, 3, 6, 4, 6, 2, 8, 4, 8, 4, 4, 2, 12, 2, 4, 6, 7, 4, 8, 2, 
6 <i(fi), the number of divisors of n, n > 1 

12. 0, 1, 2, 2, 3, 3, 4, 4, 4, 4, 5, 5, 6, 6, 6, 6, 7, 7, 8, 8, 8, 8, 9, 9, 9, 9, 9, 9, 10, 10, 11, 11, 

II, 11, 11, 11, 12, 12, 12, 12, 13, 13, 14, 14, 14, 14, 15, 15, 15, 15, 15, 15, 16, 16, 16, 
16 7r(rt), the number of primes < n, for n > 1 

13. 1, 1, 2, 2, 3, 4, 5, 6, 8, 10, 12, 15, 18, 22, 27, 32, 38, 46, 54, 64, 76, 89, 104, 122, 
142, 165, 192, 222, 256, 296, 340, 390, 448, 512, 585, 668, 760, 864, 982, 1113, 1260, 
1426 Number of partitions of n into distinct parts, n > 1 

14. 1, 1, 2, 2, 4, 2, 6, 4, 6, 4, 10, 4, 12, 6, 8, 8, 16, 6, 18, 8, 12, 10, 22, 8, 20, 12, 18, 12, 28, 
8, 30, 16, 20, 16, 24, 12, 36, 18, 24, 16, 40, 12, 42, 20, 24, 22, 46, 16, 42 

Euler totient function 4>(n) : count numbers < n and prime to n, for n > 1 
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15. 1, 1, 1, 0, 1, 1, 2, 2, 4, 5, 10, 14, 26, 42, 78, 132, 249, 445, 842, 1561, 2988, 5671, 
10981, 21209, 41472, 81181, 160176, 316749, 629933, 1256070, 2515169, 5049816 

Number of series-reduced trees with n unlabeled nodes, n > 

16. 1, 2, 3, 4, 5, 7, 8, 9, 11, 13, 16, 17, 19, 23, 25, 27, 29, 31, 32, 37, 41, 43, 47, 49, 53, 
59, 61, 64, 67, 71, 73, 79, 81, 83, 89, 97, 101, 103, 107, 109, 113, 121, 125, 127, 128, 
131 Powers of prime numbers 

17. 1, 2, 3, 4, 6, 8, 10, 12, 16, 18, 20, 24, 30, 36, 42, 48, 60, 72, 84, 90, 96, 108, 120, 144, 
168, 180, 210, 216, 240, 288, 300, 336, 360, 420, 480, 504, 540, 600, 630, 660 

Highly abundant numbers: where sum-of-divisors function increases 

18. 1, 2, 3, 4, 6, 8, 11, 13, 16, 18, 26, 28, 36, 38, 47, 48, 53, 57, 62, 69, 72, 77, 82, 87, 
97, 99, 102, 106, 114, 126, 131, 138, 145, 148, 155, 175, 177, 180, 182, 189, 197, 206, 
209 Ulam numbers: next is uniquely the sum of 2 earlier terms 

19. 2, 3, 5, 7, 11, 13, 17, 19, 23, 29, 31, 37, 41, 43, 47, 53, 59, 60, 61, 67, 71, 73, 79, 
83, 89, 97, 101, 103, 107, 109, 113, 127, 131, 137, 139, 149, 151, 157, 163, 167, 168, 
173 Orders of simple groups 

20. 2, 3, 5, 7, 11, 13, 17, 19, 23, 29, 31, 37, 41, 43, 47, 53, 59, 61, 67, 71, 73, 79, 83, 89, 
97, 101, 103, 107, 109, 113, 127, 131, 137, 139, 149, 151, 157, 163, 167, 173, 179, 
181 Prime numbers 

21. 1, 2, 3, 5, 7, 11, 15, 22, 30, 42, 56, 77, 101, 135, 176, 231, 297, 385, 490, 627, 792, 
1002, 1255, 1575, 1958, 2436, 3010, 3718, 4565, 5604, 6842, 8349, 10143, 12310, 
14883 Number of partitions of n, n > 1 

22. 2, 3, 5, 7, 13, 17, 19, 31, 61, 89, 107, 127, 521, 607, 1279, 2203, 2281, 3217, 
4253, 4423, 9689, 9941, 11213, 19937, 21701, 23209, 44497, 86243, 110503, 132049, 
216091, 756839, 859433 Mersenne primes: n such that T - 1 is prime 

23. 1, 1, 2, 3, 5, 8, 13, 21, 34, 55, 89, 144, 233, 377, 610, 987, 1597, 2584, 4181, 
6765, 10946, 17711,28657,46368,75025, 121393, 196418,317811,514229,832040, 
1346269 Fibonacci numbers: F(n) = F(n - 1) + F(n - 2) 

24. 1, 2, 3, 6, 10, 20, 35, 70, 126, 252, 462, 924, 1716, 3432, 6435, 12870, 24310, 48620, 
92378, 184756, 352716, 705432, 1352078, 2704156, 5200300, 10400600, 20058300 

Central binomial coefficients: C(n, \n/2\),n > 1 

25. 1, 1, 2, 3, 6, 11, 20, 40, 77, 148, 285, 570, 1120, 2200, 4323, 8498, 16996, 33707, 
66844, 132568, 262936, 521549, 1043098, 2077698, 4138400, 8243093 

Stern's sequence: a(n + 1) is sum of preceding |" \ /8 "+ 1 - 1 .j terms, n > 1 

26. 1, 1, 2, 3, 6, 11, 22, 42, 84, 165, 330, 654, 1308, 2605, 5210, 10398, 20796, 41550, 
83100, 166116, 332232, 664299, 1328598, 2656866, 5313732, 10626810 

Narayana-Zidek-Capell numbers: a(2n) = 2a(2n — 1), a(2n + 1) = 2a(2n) — 
a(n) 

27. 1, 1, 1,2,3,6, 11,23,46,98,207,451,983,2179,4850, 10905,24631,56011, 127912, 
293547, 676157, 1563372, 3626149, 8436379, 19680277, 46026618, 107890609 

Wedderburn-Etherington numbers: interpretations of X n , n > 1 

28. 1, 1, 1, 2, 3, 6, 11, 23, 47, 106, 235, 551, 1301, 3159, 7741, 19320, 48629, 123867, 
317955, 823065, 2144505, 5623756, 14828074, 39299897, 104636890, 
279793450 Number of trees with n unlabeled nodes, n > 1 

29. 2, 3, 6, 20, 168, 7581, 7828354, 2414682040998, 56130437228687557907788 
Dedekind numbers: number of monotone Boolean functions of n variables, n > 
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30. 1, 1, 2, 3, 7, 16, 54, 243, 2038, 33120, 1182004, 87723296, 12886193064, 
3633057074584, 1944000150734320, 1967881448329407496 

Number of Euler graphs or 2-graphs with n nodes, n > 1 

31. 0, 0, 1, 1, 2, 3, 7, 18, 41, 123, 367, 1288, 4878 

Number of alternating prime knots with n crossings, n > 1 

32. 0, 0, 1, 1, 2, 3, 7, 21, 49, 165, 552, 2176, 9988 

Number of prime knots with n crossings, n > 1 

33. 1, 1, 2, 3, 8, 14, 42, 81, 262, 538, 1828, 3926, 13820, 30694, 110954, 252939, 933458, 
2172830, 8152860, 19304190, 73424650, 176343390, 678390116, 1649008456 

Meandric numbers: ways a river can cross a road n times, n > 1 

34. 0, 1, 2, 4, 5, 8, 9, 10, 13, 16, 17, 18, 20, 25, 26, 29, 32, 34, 36, 37, 40, 41, 45, 49, 50, 

52, 53, 58, 61, 64, 65, 68, 72, 73, 74, 80, 81, 82, 85, 89, 90, 97, 98, 100, 101, 104, 
106 Numbers that are sums of 2 squares 

35. 1, 2, 4, 5, 8, 10, 14, 15, 16, 21, 22, 25, 26, 28, 33, 34, 35, 36, 38, 40, 42, 46, 48, 49, 50, 

53, 57, 60, 62, 64, 65, 70, 77, 80, 81, 83, 85, 86, 90, 91, 92, 100, 104, 107 

MacMahon's prime numbers of measurement, or segmented numbers 

36. 1, 2, 4, 6, 10, 14, 20, 26, 36, 46, 60, 74, 94, 114, 140, 166, 202, 238, 284, 330, 390, 
450, 524, 598, 692, 786, 900, 1014, 1154, 1294, 1460, 1626, 1828, 2030, 2268, 2506 

Binary partitions (partitions of 2n into powers of 2), n > 

37. 1, 2, 4, 8, 16, 32, 64, 128, 256, 512, 1024, 2048, 4096, 8192, 16384, 32768, 65536, 
131072, 262144, 524288, 1048576, 2097152, 4194304, 8388608, 16777216, 
33554432, 67108864, 134217728, 268435456, 536870912 Powers of 2 

38. 1, 1, 2, 4, 9, 20, 48, 115, 286, 719, 1842, 4766, 12486, 32973, 87811, 235381, 
634847, 1721159, 4688676, 12826228, 35221832, 97055181, 268282855, 743724984, 
2067174645 Number of rooted trees with n unlabeled nodes, n > 1 

39. 1, 1,2,4,9,21,51, 127,323,835,2188,5798, 15511,41835, 113634,310572,853467, 
2356779, 6536382, 18199284, 50852019, 142547559, 400763223, 1129760415 

Motzkin numbers: ways to join n points on a circle by chords 

40. 1, 1, 2, 4, 9, 22, 59, 167, 490, 1486, 4639, 14805, 48107, 158808, 531469, 1799659, 
6157068, 21258104, 73996100, 259451116, 951695102, 3251073303 

Number of different scores in n-team round-robin tournament, n > 1 

41. 1, 1, 2, 4, 11, 34, 156, 1044, 12346, 274668, 12005168, 1018997864, 
165091172592, 50502031367952, 29054155657235488, 31426485969804308768 

Number of graphs with n unlabeled nodes, n > 

42. 0, 1, 2, 5, 12, 29, 70, 169, 408, 985, 2378, 5741, 13860, 33461, 80782, 195025, 
470832, 1136689, 2744210, 6625109, 15994428, 38613965, 93222358, 225058681, 
543339720 Pell numbers: a(n) = 2a(n - 1) + a(n - 2) 

43. 1, 1, 2, 5, 12, 35, 108, 369, 1285, 4655, 17073, 63600, 238591, 901971, 3426576, 
13079255, 50107909, 192622052, 742624232, 2870671950, 11123060678, 
43191857688, 168047007728, 654999700403 Polyominoes with n cells, n > 1 

44. 1, 1, 2, 4, 12, 56, 456, 6880, 191536, 9733056, 903753248, 154108311168, 
48542114686912, 28401423719122304, 31021002160355166848 

Number of outcomes of n-team round-robin tournament, n > 1 

45. 1, 1, 2, 5, 14, 38, 120, 353, 1148, 3527, 11622, 36627, 121622, 389560, 1301140, 
4215748, 13976335,46235800, 155741571,512559185, 1732007938, 
5732533570 Number of ways to fold a strip of n blank stamps, n > 1 
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46. 1, 1, 2, 5, 14, 42, 132, 429, 1430, 4862, 16796, 58786, 208012, 742900, 2674440, 
9694845, 35357670, 129644790, 477638700, 1767263190, 6564120420, 
24466267020 Catalan numbers: C(2n, n)/(n + 1), n > 

47. 1, 1, 2, 5, 15, 52, 203, 877, 4140, 21147, 115975, 678570, 4213597, 27644437, 
190899322, 1382958545, 10480142147, 82864869804, 682076806159, 
5832742205057 Bell or exponential numbers: expansion of e {e " _1) 

48. 1, 1, 1, 2, 5, 16, 61, 272, 1385, 7936, 50521, 353792, 2702765, 22368256, 199360981, 
1903757312, 19391512145, 209865342976, 2404879675441, 

29088885112832 Euler numbers: expansion of sec x + tan x 

49. 0, 2, 6, 12, 20, 30, 42, 56, 72, 90, 110, 132, 156, 182, 210, 240, 272, 306, 342, 380, 
420, 462, 506, 552, 600, 650, 702, 756, 812, 870, 930, 992, 1056, 1122, 1190, 1260, 
1332 Pronic numbers: n(n + 1), n > 

50. 1, 2, 6, 20, 70, 252, 924, 3432, 12870, 48620, 184756, 705432, 2704156, 10400600, 
40116600, 155117520, 601080390, 2333606220, 9075135300, 

35345263800 Central binomial coefficients: C(2n, n),n>0 

51. 1, 1, 1,2, 6, 21, 112, 853, 11117,261080, 11716571, 1006700565, 
164059830476, 50335907869219, 29003487462848061, 31397381142761241960 

Number of connected graphs with n unlabeled nodes, n > 

52. 1, 2, 6, 22, 101, 573, 3836, 29228, 250749, 2409581, 25598186, 296643390, 
3727542188, 50626553988, 738680521142 

Kendall-Mann numbers: maximal inversions in permutation of n letters, n > 1 

53. 1, 1, 2, 6, 24, 120, 720, 5040, 40320, 362880, 3628800, 39916800, 479001600, 
6227020800, 87178291200, 1307674368000, 20922789888000, 355687428096000, 
6402373705728000 Factorial numbers: n\, n > 

54. 1,2,7,42,429,7436,218348, 10850216,911835460, 129534272700, 
31095744852375, 12611311859677500, 8639383518297652500 

Robbins numbers: UtZoi^ + 1 )V(» + k ) l > n > 1 

55. 1, 2, 8, 42, 262, 1828, 13820, 110954, 933458, 8152860, 73424650, 678390116, 
6405031050, 61606881612, 602188541928, 5969806669034, 59923200729046 

Closed meandric numbers: ways a loop can cross a road 2n times, n > 1 

56. 1, 2, 8, 48, 384, 3840, 46080, 645120, 10321920, 185794560, 3715891200, 
81749606400, 1961990553600, 51011754393600, 1428329123020800, 
42849873690624000 Double factorial numbers: (2n)!! = 2 n n\, n > 

57. 0, 1, 2, 9, 44, 265, 1854, 14833, 133496, 1334961, 14684570, 176214841, 2290792932, 
32071101049,481066515734, 7697064251745, 130850092279664 

Derangements: permutations of n elements with no fixed points, n > 1 

58. 1, 2, 16, 272, 7936, 353792, 22368256, 1903757312, 209865342976, 
29088885112832, 4951498053124096, 1015423886506852352, 
246921480190207983616 Tangent numbers: expansion of tan x 

59. 1, 3, 4, 7, 6, 12, 8, 15, 13, 18, 12, 28, 14, 24, 24, 31, 18, 39, 20, 42, 32, 36, 24, 60, 
31, 42, 40, 56, 30, 72, 32, 63, 48, 54, 48, 91, 38, 60, 56, 90, 42, 96, 44, 84, 78, 72, 48, 
124 cr(n), sum of the divisors of n, n > 1 

60. 1, 3, 4, 7, 9, 12, 13, 16, 19, 21, 25, 27, 28, 31, 36, 37, 39, 43, 48, 49, 52, 57, 61, 63, 
64, 67, 73, 75, 76, 79, 81, 84, 91, 93, 97, 100, 103, 108, 109, 111, 112, 117, 121, 124, 
127 Numbers of the form x 2 + xy + y 2 
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61. 1, 3, 4, 7, 11, 18, 29, 47, 76, 123, 199, 322, 521, 843, 1364, 2207, 3571, 5778, 9349, 
15127, 24476, 39603, 64079, 103682, 167761, 271443, 439204, 710647, 1149851, 
1860498 Lucas numbers: L(n) = L(n - 1) + L(n - 2) 

62. 1, 1, 1, 3, 4, 12, 27, 82, 228, 733, 2282, 7528, 24834, 83898, 285357, 983244, 
3412420, 11944614, 42080170, 149197152, 531883768, 1905930975, 6861221666, 
24806004996 Number of ways to cut an n-sided polygon into triangles, n > 1 

63. 1, 3, 6, 10, 15, 21, 28, 36, 45, 55, 66, 78, 91, 105, 120, 136, 153, 171, 190, 210, 231, 
253, 276, 300, 325, 351, 378, 406, 435, 465, 496, 528, 561, 595, 630, 666, 703, 741, 
780 Triangular numbers: n(n + l)/2, n > 1 

64. 1, 3, 6, 11, 17, 25, 34, 44, 55, 72, 85, 106, 127, 151 

Shortest Golomb ruler with n marks, n > 2 

65. 1, 3, 6, 13, 24, 48, 86, 160, 282, 500, 859, 1479, 2485, 4167, 6879, 11297, 18334, 
29601, 47330, 75278, 118794, 186475, 290783, 451194, 696033, 1068745, 1632658 

Number of planar partitions of n, n > 1 

66. 1, 3, 7, 9, 13, 15, 21, 25, 31, 33, 37, 43, 49, 51, 63, 67, 69, 73, 75, 79, 87, 93, 99, 
105, 111, 115, 127, 129, 133, 135, 141, 151, 159, 163, 169, 171, 189, 193, 195, 201, 
205 Lucky numbers (defined by sieve similar to prime numbers) 

67. 1, 3, 7, 19, 47, 130, 343, 951, 2615, 7318, 20491, 57903, 163898, 466199, 1328993, 
3799624, 10884049, 31241170, 89814958, 258604642 

Number of mappings from n unlabeled points to themselves, n > 1 

68. 1, 3, 9, 25, 65, 161, 385, 897, 2049, 4609, 10241, 22529, 49153, 106497, 229377, 
491521, 1048577, 2228225, 4718593, 9961473, 20971521, 44040193, 

92274689 Cullen numbers: n ■ 2" + 1, n > 

69. 1, 3, 9, 27, 81, 243, 729, 2187, 6561, 19683, 59049, 177147, 531441, 1594323, 
4782969, 14348907, 43046721, 129140163, 387420489, 1162261467, 3486784401, 
10460353203 Powers of 3 

70. 1,3,9,33, 139,718,4535 

Number of topologies or transitive-directed graphs with n unlabeled nodes, n > 1 

71. 1, 1,3, 11,45, 197,903,4279,20793, 103049,518859,2646723, 13648869,71039373, 
372693519, 1968801519, 10463578353,55909013009, 300159426963 

Schroeder's second problem: ways to interpret XiX 2 . . . X n , n > 1 

72. 1, 3, 11, 50, 274, 1764, 13068, 109584, 1026576, 10628640, 120543840, 1486442880, 
19802759040, 283465647360, 4339163001600, 70734282393600, 
1223405590579200 Stirling cycle numbers: ["],"> 2. 

73. 1, 3, 13, 75, 541, 4683, 47293, 545835, 7087261, 102247563, 1622632573, 
28091567595, 526858348381, 10641342970443, 230283190977853, 
5315654681981355 Preferential arrangements of n things, n > 1 

74. 1, 3, 15, 105, 945, 10395, 135135, 2027025, 34459425, 654729075, 13749310575, 
316234143225, 7905853580625, 213458046676875, 6190283353629375 

Double factorial numbers: (2n + 1)!! = 1 ■ 3 ■ 5 • • • (2n + 1), n > 1 

75. 1, 3, 16, 125, 1296, 16807, 262144, 4782969, 100000000, 2357947691, 
61917364224, 1792160394037, 56693912375296, 1946195068359375, 
72057594037927936 Number of trees with n labeled nodes: n n ~ 2 , n>2 

76. 1, 3, 16, 218, 9608, 1540944, 882033440, 1793359192848, 13027956824399552, 
341260431952972580352, 325229093850558861 1 1 197440 

Directed graphs with n unlabeled nodes, n > 1 
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77. 1, 1, 3, 17, 155, 2073, 38227, 929569, 28820619, 1109652905, 51943281731, 
2905151042481, 191329672483963, 14655626154768697, 1291885088448017715 

Genocchi numbers: expansion of tan(a;/2) 

78. 0, 1, 4, 5, 16, 17, 20, 21, 64, 65, 68, 69, 80, 81, 84, 85, 256, 257, 260, 261, 272, 273, 
276, 277, 320, 321, 324, 325, 336, 337, 340, 341, 1024, 1025, 1028, 1029, 1040, 1041 

Moser-de Bruijn sequence: sums of distinct powers of 4 

79. 4, 7, 8, 9, 10, 11, 12, 12, 13, 13, 14, 15, 15, 16, 16, 16, 17, 17, 18, 18, 19, 19, 19, 
20, 20, 20, 21, 21, 21, 22, 22, 22, 23, 23, 23, 24, 24, 24, 24, 25, 25, 25, 25, 26, 26, 
26 Chromatic number of surface of genus n, n > 

80. 1, 4, 9, 16, 25, 36, 49, 64, 81, 100, 121, 144, 169, 196, 225, 256, 289, 324, 361, 400, 
441, 484, 529, 576, 625, 676, 729, 784, 841, 900, 961, 1024, 1089, 1156, 1225, 1296 

The squares 

81. 1, 4, 10, 19, 31, 46, 64, 85, 109, 136, 166, 199, 235, 274, 316, 361, 409, 460, 514, 
571, 631, 694, 760, 829, 901, 976, 1054, 1135, 1219, 1306, 1396, 1489, 1585, 1684, 
1786 Centered triangular numbers: (3n 2 + 3n + 2)/2, n > 

82. 1, 4, 10, 20, 35, 56, 84, 120, 165, 220, 286, 364, 455, 560, 680, 816, 969, 1140, 1330, 
1540, 1771, 2024, 2300, 2600, 2925, 3276, 3654, 4060, 4495, 4960, 5456, 5984 

Tetrahedral numbers: C(n + 3, 3), n > 

83. 1, 1, 4, 26, 236, 2752, 39208, 660032, 12818912, 282137824, 6939897856, 
188666182784, 5617349020544, 181790703209728, 6353726042486272 

Schroeder's fourth problem: families of subsets of an n set, n > 1 

84. 1, 4, 29, 355, 6942, 209527, 9535241, 642779354, 63260289423, 
8977053873043, 1816846038736192, 519355571065774021 

Number of transitive-directed graphs with n labeled nodes, n > 1 

85. 1, 5, 12, 22, 35, 51, 70, 92, 117, 145, 176, 210, 247, 287, 330, 376, 425, 477, 532, 
590, 651, 715, 782, 852, 925, 1001, 1080, 1162, 1247, 1335, 1426, 1520, 1617, 1717, 
1820 Pentagonal numbers: n(3n — l)/2, n > 1 

86. 1, 5, 13, 25, 41, 61, 85, 113, 145, 181, 221, 265, 313, 365, 421, 481, 545, 613, 685, 
761, 841, 925, 1013, 1105, 1201, 1301, 1405, 1513, 1625, 1741, 1861, 1985, 2113, 
2245 Centered square numbers: n 2 + (n — l) 2 , n > 1 

87. 1, 5, 14, 30, 55, 91, 140, 204, 285, 385, 506, 650, 819, 1015, 1240, 1496, 1785, 2109, 
2470, 2870, 3311, 3795, 4324, 4900, 5525, 6201, 6930, 7714, 8555, 9455, 10416 

Square pyramidal numbers: n(n + l)(2n + l)/6, n > 1 

88. 1, 5, 25, 125, 625, 3125, 15625, 78125, 390625, 1953125, 9765625, 48828125, 
244140625, 1220703125, 6103515625, 30517578125, 152587890625, 762939453125, 
38 14697265625 Powers of 5 

89. 1, 5, 52, 1522, 145984, 48464496, 56141454464, 229148550030864, 
3333310786076963968, 174695272746749919580928 

Number of possible relations on n unlabeled points, n > 1 

90. 1, 1, 5, 61, 1385, 50521, 2702765, 199360981, 19391512145, 2404879675441, 
370371188237525, 69348874393137901, 15514534163557086905, 
4087072509293123892361 Euler numbers: expansion of sec z 

91. 1, 5, 109, 32297, 2147321017, 9223372023970362989, 
170141183460469231667123699502996689125 

Number of ways to cover an n set, n > 1 
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92. 1, 6, 15, 28, 45, 66, 91, 120, 153, 190, 231, 276, 325, 378, 435, 496, 561, 630, 703, 
780, 861, 946, 1035, 1128, 1225, 1326, 1431, 1540, 1653, 1770, 1891, 2016, 2145, 
2278 Hexagonal numbers: n(2n — 1), n > 1 

93. 1, 6, 25, 90, 301, 966, 3025, 9330, 28501, 86526, 261625, 788970, 2375101, 7141686, 
21457825, 64439010, 193448101, 580606446, 1742343625, 5228079450, 
15686335501 Stirling subset numbers: { n 3 }, n > 3 

94. 6, 28, 496, 8128, 33550336, 8589869056, 137438691328, 
2305843008139952128, 2658455991569831744654692615953842176 

Perfect numbers: equal to the sum of their proper divisors 

95. 1, 8, 21, 40, 65, 96, 133, 176, 225, 280, 341, 408, 481, 560, 645, 736, 833, 936, 1045, 
1160, 1281, 1408, 1541, 1680, 1825, 1976, 2133, 2296, 2465, 2640, 2821, 3008, 3201 

Octagonal numbers: n(3n — 2), n > 1 

96. 1, 8, 27, 64, 125, 216, 343, 512, 729, 1000, 1331, 1728, 2197, 2744, 3375, 4096, 4913, 
5832, 6859, 8000, 9261, 10648, 12167, 13824, 15625, 17576, 19683, 21952, 24389 

The cubes 

97. 1, -24, 252, -1472, 4830, -6048, -16744, 84480, -113643, -115920, 534612, 
-370944, -577738, 401856, 1217160, 987136, -6905934, 2727432, 

10661420 Ramanujan r function 

98. 341, 561, 645, 1105, 1387, 1729, 1905, 2047, 2465, 2701, 2821, 3277, 4033, 4369, 
4371,4681,5461,6601,7957, 8321,8481,8911, 10261, 10585, 11305, 12801, 13741, 
13747 Sarrus numbers: pseudo-primes to base 2 

99. 561, 1105, 1729,2465,2821,6601,8911, 10585, 15841,29341,41041,46657,52633, 
62745, 63973, 75361, 101101, 115921, 126217, 162401, 172081, 188461, 252601, 
278545 Carmichael numbers 

100. 1, 744, 196884, 21493760, 864299970, 20245856256, 333202640600, 

4252023300096, 44656994071935, 401490886656000, 3176440229784420, 
22567393309593600 Coefficients of the modular function j 

For more information about these sequences and tens of thousands of others, includ- 
ing formulae and references, see "The On-Line Encyclopedia of Integer Sequences", 
published electronically at www . research . att . com/~nj as/ sequences/. 



1 .3 SERIES AND PRODUCTS 



1.3.1 DEFINITIONS 

If {a n } is a sequence of numbers or functions, then 

1. S/v = 2~2n=i a n = a i + a 2 + ••• + (In is the N lh partial sum. 

2. For an in nite series: S = limjv_ i . 00 Sn = Yl^Li a « ( wnen me nm it exists). 
Then S is called the sum of the series. 
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3. The series is said to converge if the limit exists and diverge if it does not. 

4. If a n = b n x n , where b n is independent of x, then S is called a power series. 

5. If a n = (— l) n |a„|, then S is called an alternating series. 

6. If ^2 \ a„ \ converges, then the series converges absolutely. 

7. If Sn converges, but not absolutely, then it converges conditionally. 

EXAMPLES 

1. The harmonic series 5 = 1 + | + | + ... diverges. The corresponding alternating 
series (called the alternating harmonic series) S = 1 — f + | — ■■■ + (— l) n-1 ^ + ... 
converges (conditionally) to log 2. 

2. The harmonic numbers are H n = J2k=i \- The rst few values are {1, §, il, |§, ... }. 
Asymptotically, H n ~ In n + 7 + ^ . 

A „ l-a^ 1 . 

3. SW = > a; n = if a; 9^ 1. 

^-i 1 - a; 



1.3.2 GENERAL PROPERTIES 

1 . Adding or removing a nite number of terms does not affect the convergence 
or divergence of an in nite series. 

2. The terms of an absolutely convergent series may be rearranged in any manner 
without affecting its value. 

3. A conditionally convergent series can be made to converge to any value by 
suitably rearranging its terms. 

4. If the component series are convergent, then 

^2(aa n + /3b n ) = a E a n + /3 E b n . 

(00 \ / 00 \ 00 
E a ™ I E bn ) = E Cn wnere c « = a oK + ai&n-i H 1" a n bo- 

6. Summation by parts: let J2 a n an d J2 converge. Then 

E «ii&n = E SnC&n - 6„+i) 

where S n is the n th partial sum of J2 a n- 

7. A power series may be integrated and differentiated term-by- term within its 
interval of convergence. 

8. Schwarz inequality: 

1/2/^. ,,\l/2 



Ekim<(Eki 2 ) (Em 2 ) 



© 2003 by CRC Press LLC 



9. Holder's inequality: when 1/p + 1/q = 1 and p, q > 1 

Ekm< (Eki p ) Vp (Ei fe «i 9 ) 1/9 

10. Minkowski's inequality: whenp> 1 

(EK+^r) 1/P <(EKi p ) 1/P + (EM p ) 1/P 

11. Arithmetic mean-geometric mean inequality: If a, > then 

> (aia 2 ■■■a n ) 

n 

12. Kantorovich inequality: Suppose that < x\ < x-i < . . . < x n . If A, > 
and Yl7=i = men 



(E^.)(E^)<^- 

where A = ^ (x\ + x n ) and G = ^Jx\x n . 



EXAMPLES 

1. Let T be the alternating harmonic series 5 rearranged so that each positive term is 
followed by the next two negative terms. By combining each positive term of T with 
the succeeding negative term, we nd that T3N = \S2N- Hence, T = | log 2. 

2. The series 1 + f — | + | + | — | + y + § — § + ••• diverges, whereas 
converges to log(2%/2). 



1.3.3 CONVERGENCE TESTS 

1. Comparison test: If \a n \ <b n and ^ b n converges, then ^ a„ converges. 

2. Li'mi/ /esf: If lim„_ i . 00 a„ ^ 0, or the limit does not exist, then ^ a„ is 
divergent. 

3. Ratio test: Let p = lim„_ i . 00 l^^l. If p < 1, the series converges absolutely. 
If p > 1, the series diverges. 

4. Cauchy root test: Let <r = lim„_ i . 00 la,,! 1 /™. If a < 1, the series converges. 
If a > 1, it diverges. 

5. Integral test: Let |a„| = /(n) with /(a;) being monotone decreasing, and 
lirriz-j.oo f{x) = 0. Then J"^° f(x) dx and ^ a„ both converge or both diverge 
for any A > 0. 
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6. Gauss's test: If 



P A n 

1 h — where q > 1 and the sequence {A n \ 

n n q " 



is bounded, then the series is absolutely convergent if and only if p > 1. 

7. Alternating series test: If \a n \ tends monotonically to 0, then l) n |a n | 
converges. 



EXAMPLES 

1. For 5 = X^^Li w c £ n > P = limn^oo(l + ^) c x = x. Hence, using the ratio test, 5 
converges for < x < 1 and any value of c. 

2. For 5 = Y,7=i S^' a = lim «^°°(^ir) 1/n = 5 - Therefore the series diverges. 

3. For 5 = J2n=i n ~ t - consider fix) = x~K Then 



da: | ^— ^ for t > 1 
I diverges for t < 1 



Hence, 5 converges for t > 1. 

4. The sum ^^L 2 n (iogn)« conver g es f° r s > 1 by the integral test. 

5. Let a„ = ^f- = c ( c + 1 )-^( c +"- 1 ) where c is not or a negative integer. Then 
\a n +i/a n \ = 1 — (c + l)/n + (c + l)/n 2 (l + 1/n). By Gauss's test, the series 
converges absolutely if and only if c > 0. 



1.3.4 TYPES OF SERIES 
1.3.4.1 Bessel series 

oo 

1. Fourier-Bessel series: Oi n J v (j v ^ n z) (jv,k 1S a zero of J v {x)) 

oo 

2. Neumann series: a n J v+n {z) 

oo 

3. Kapteyn series: ^ a n J v + n \iyV + n)z] 

n=0 

oo 

4. Schldmilch series: a n J v (nz) 

n=l 

EXAMPLES 

S^Lo ^T^+n(2) = r(i/+i) 

2 - E~=i J »M = for < « < 1 

3 - £~=i(-l)" +1 ■*>(»**) = | for < « < 7T 
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1.3.4.2 Dirichlet series 

These are series of the form E^Li ^t- They converge for x > xo, where xq is the 
abscissa of convergence. Assuming the limits exist: 

log \ a\ H h a n \ 



1 . If Y] a„ diverges, then a;o = lim 

n— foo 

2. If ^ a„ converges, then xq = lim 



logn 

log \a n+ i + a w+2 + 
logn 



EXAMPLES 

1. Riemann zeta function: = X^^Li a!o = 1 

2. JD^Li B ^ = ^Jj! x = 1 (p(n) denotes the Mobius function; see Section 2.4.9) 

3. Y^Li 1^ = C 2 ( x )j x o = 1 is the number of divisors of n; see page 128) 



1.3.4.3 Fourier series 

If f(x) satis es certain properties, then (see page 48) 

oo 

f( x ) = y + 2^ v a « cos ~y/~ + ° n sm ~77~ J (1.3.1) 

n-l 

1. If /(x) has the Laplace transform F(k) = e~ xk f(x) dx, then 

£ w = 5 f co Iw : Si, / w *■ 

^ (1.3.2) 

V F(fc) sin(fci) = - / — — ^ 7T 

£J 2 io cosh(a:) - cos(t) 

2. Since the cosine transform of (cosh(a;)— cos(i)) _1 with respect to xisir csc(i) 
csch(7ry) sinh(7r — t)y, we nd that 

k sin(fci) 7r sinh(7r — t)y 
k 2 +y 2 ~ 2 sinh(7rw) 

A'— 1 

3. e~ ! = m p ^rr ^^^.foro < * < \ 

4. E~ i = ^ W*M*> for < a; < | 

c V^oo sin((2w+l)7ra;-7rfc/2) _ 7r fc + 1 p / \ 
J - Z^n=l (2n + l) fe + 1 ~~ ik\ ^kXX ) 

6. Er =1 sin ( na; ) = i- 2 :ff,u for h < 1 

7- E~ o «" «»(™0 = r^g^ for \a\ < 1 
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1.3.4.4 Hypergeometric series 

The hypergeometric function is 



TP 



b\ b 2 



£ 

n=0 



(«l)n(«2)n ■ ■ ■ (a p )n X n 
(&l)n(&2)n • • • (bq)n Tl\ 



(1.3.3) 



where (o) n = T(a + n) /T(a) is the shifted factorial. Any in nite series ^ A n with 
A n+ i/A n a rational function of n is a hypergeometric series. These include series 
of products and quotients of binomial coef cients. 

EXAMPLES 



1. 2*1 



( °' 6 1 1 ) 



r(c)r(c-a-6) 

r(c-o)r( c -6) 



(Gauss) 



2. 3-F2 



-n, 



a. 



c, 1 + a + 6 — c — n 



(c - a) n (c - 6) n 

(c)„(c - a - 6)„ 



(Saalschutz) 



3. 4F3 



a, 1 + a/2, 6, 
a/2, l + a-6, 1 + 26- 



(a-2b)„(-b) n 
(l + a-6)„(-26)„ 



(Bailey) 



4- £(-D 



2n\ /2n+m+l\ 
Mn+2m+2x ( 3 + 2 V 2 ) 



/-4n+2m+2\ 
I 2m ) 



(3/4) B (5/4)„ 
(7/8)„(9/8)„ 



1 .3.4.5 Power series 

1. The values of x, for which the power series J]^Lo a « a; ™ converges, form an 
interval (interval of convergence) which may or may not include one or both 
endpoints. 

2. A power series may be integrated and differentiated term-by-term within its 
interval of convergence. 

3. Note that [1 + Xl^Li ctn^™] -1 = 1 — S^Li ^n^™! where b\ = a\ and b n = 
a n + YJlZi bn-kdk forn > 2. 

4. Inversion of power series: If s = ^^Li a n x n , then a; = 2^^Li A n s n , where 
A\ = 1/ai, = —02/01,^.3 = (2a| — aia3)/af, = (5010203—0104 — 
5a|)/ a i' ^5 = (6010204 + 3afa| + 14a! - a 3 i a 5 ~ 21 010^03) /a?. 



1.3.4.6 Taylor series 

1 . Taylor series in 1 variable: 



f(a + x) = T^—p-x n + R N 

n=0 
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or 

f(x) = f(a) + f(a)(x -a) + ^-(x - a) 2 + ^f^(x - a) 3 + 
or, specializing to a = 0, results in the MacLaurin series 

fix) = /(0) + f(0)x + f -^x 2 + f -^x 3 + .... 

2. Lagrange's form of the remainder: 

R N = ___/( w + 1 )( a + Ox), for some < 6 < 1. 

3. Taylor series in 2 variables: 

f(a + x,b + y) = f(a,b) + xf x (a,b) +yf y (a,b) + 

[x 2 fxx(a, b) + 2xyf xy (a, b) + y 2 f yy (a, b)] + . . 

4. Taylor series for vectors: 

/(a + x) = J2 [(X ' V) 7 Ka) + fl "(a) = /( a ) + x ' V/(a) + ■ ■ ■ ■ 

n=0 



EXAMPLES 

1. Binomial series: 

( X +vr = Y r(l/+1) " v "" 

n=0 v ' 

When v is a positive integer, this series terminates at n = v. 

2- 7 l^ = Er=o{lf^forN<l/4 

3- = En=0 ^«(*)^T 

3 - 2^n=l (n+l)(n+3) — ^ JO UaU Jo at 2^0 1 

= ^r[x+±x 2 + (l- x 2 ) log(l - a;)] for |a;| < 1 
6- 2ZT=i £ = Li n( x ) (polylogarithm) 

1.3.4.7 Telescoping series 

If lim^oo F(n) = 0, then 2~2^il F ( n ) ~ F ( n + X )] = ^W- For example, 



£(n + l)(n + 2) ^ 



n + 1 n + 2 



5. d.3.4) 
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The GWZ algorithm expresses a proposed identity in the form of a telescoping 
series J2 k [F(n + 1, k) — F(n, k)] = 0, then searches for a G(n, k) that satis es 
F{n + 1, k) - F{n, k) = G{n, k + 1) - G(n, k) and G(n, ±oo) = 0. The search 
assumes that G(n, k) = R(n, k)F(n, k — 1) where R(n, k) is a rational expression 
in n and k. When R is found, the proposed identity is veri ed. For example, the 
Pfaff-Saalschutz identity has the following proof: 

(a + k)l(b + k)l(c -a-b + n-l-k)\ _ (c - a + n)!(c - 6 + n)l 
^ (fc + l)!(n-fc)!(c + fc)! ~ (n + l)!(c + n)! ' 

R(n,k)- (b + k)(a + k) 



(c-b + n + l)(c - a + n + 1) ' 



1 .3.4.8 Other types of series 

1. Arithmetic series: 



N 1 
^(a + nd) Y,/ + -N(N + l)d. 



n=l 



2. Arithmetic power series: 

v^/ ^ « a - (a + bN)x N+1 bx{\ - x N ) . , t , 



3. Geometric series: 



1 + £ + a; 2 + a; 3 + • • • = — !— , (larl < 1). 

1 — x 



4. Arithmetic-geometric series: 



a 



a + (a + b)x + (a + 2b)x 2 + (a + 3b)x 3 H = h 



bx 



l-x (1-a;) 2 ' 
x|<l). 



5. Combinatorial sums: 

(a) ELo CX) = Ct 1 ) 

(b) Er=_oo(-iro = (-ire- 1 ) 

V^™ (k+m\ _ (m+n+\\ 
\ c > 2^k=0 \ k I - \ n I 

oo Y.z=-^-i) k n m ) = w 

(e) ( x )( v ) = ( x +y\ 

W A^k--oo \m+k) \n-k) \m+n) 

(f) T°° ( 1 )( x ) = I l+x ) 

W £^k=-oo \m+k) \n+k) \l-m+n) 
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(g) Er=-oo(-i)*L+Jffi = (-!)' +m (7-?) 

(h) EL-»(-i)*(m%-„) = (-iy +m rr-i) 

« E'*=0 Cm ) Ct*) = (m+n+l) > *) 

6. Generating functions: 

(a) Bessel functions: E^-oo Jk{x)z k = exp(|x 2 ^i) 

(b) Chebyshev polynomials: £~ x T„(a;)z n = 

(c) Hermite polynomials: g "J^ z " = exp(2a;2; — z 2 ) 

(d) Laguerre polynomials: E^Lo ^"'W 2 ™ = (1 — z)~ a ~ 1 exp[-^-] 

(e) Legendre polynomials: J2^L P n (z)x n = -p=== , for \x\ < 1 

7. Multiple series: 

, x (-1)' + "+" _ /o 

^ v/(l+l/6) ! + (m+l/6) 2 + (n+l/6) 2 ~ 

where — oo < l,m,n < oo and they are not all zero 

(b) E ( m 2 +w 2 )* = 4/3(z)C(z) f° r — 00 < m,n < oo not both zero 
( C) ( - 1 , ) " r , r( " + i / 1 2 L ^ m+ " = y/Ze z eit( f- z) forz > 

\ ' ^m,n=0 n! r(m+n+l/2 v ,/z — z 



;m,n=0 n! r(m+n+l/2)^ V " yi_ z 

/jx m 2 — n 2 7r 

( e ) E k'ikl..kl = j£ry. for 1 < fci < • • • < fc„ < 



8. Theta series: 

oo 

e n 2 7rft+2njz = \ l - 



oo 

ft+2mz _ 4 /* e (z-n7r) 2 /7rft 
n— — oc 



9. Lagrange series: If /(z) is analytic at z = zq, f(zo) = wq, and f'(zo) ^ 0, 
then the equation w = f(z) has the unique solution z = F(w). If both 
functions are expanded 



/(*) = So + fi(z - z ) + Hz - zo) 2 + ... 
F(w) = F + F 1 (w- w ) + F 2 (w - w ) 2 + 

with F = F(w ) = z, then 



1 

F- — — 
3 " jl 



- 1 [ *-*o V 
dzi" 1 \/(z)-/ J 

fi tp _ If 2 — hh 



(1.3.5) 



(1.3.6) 



For example: F\ = j-,F 2 = F 3 = ^ji 
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1.3.5 SUMMATION FORMULAE 

1. Euler-MacLaurin summation formula: As n — > oc, 

E ~ o /(n) + / f{x) dx+c + E(-!) i+1 

where is the j th Bernoulli number and 



T3 f (j) (n) 



C= lim 

m— )-oo 



™ f (i) (0) 1 



(j + l)! 2 

( — 1 ) m /"oo 



/•CO 

/ B.+it!- [zJ)/ (m+1) 
Jo 



(m + 1)! 

2. Poisson summation formula: If / is continuous, 

i 00 />oo 00 r />oo 

^/(0) + E/( n ) = / /(*)<*■: + 2 £ / /(*) cos(2n7ra0tfc 

3. Plana' s formula: 

n -i rn oo /•(2j+l)/ \ 

£/« = ^/(n) + / /t^ + Et- 1 )'" 1 ^ 9-1 

2 7 ' i=l 



k=l 



where / is analytic, a is a constant dependent on /, and B j is the j th Bernoulli 
number. 

EXAMPLES 

" 1 IB 

1. — ~ log n + 7 + - — - — . . . where 7 is Euler's constant. 



2. l + 2j2e~ n2 



2n 2n 

CO 

l + 2j2e~* 2n2/X 



(Jacobi) 



1 .3.6 IMPROVING CONVERGENCE: SHANKS 
TRANSFORMATION 

Let s n be the n th partial sum. The sequences {S(s n )}, {S(S(s n ))}, . . . often con- 
verge successively more rapidly to the same limit as {s „}, where 

S(s n )= . (L3 . 7) 

~r ^n— 1 
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EXAMPLE For Sn = ELo(- 1 )* 2: *' we nd s ( s n) = for a11 n - 



1.3.7 SUMMABILITY METHODS 

Unique values can be assigned to divergent series in a variety of ways which preserve 
the values of convergent series. 

oo oo 

1 . Abel summation: > a„ = lim > a„r n . 

n=0 n=0 



2. Cesaro (C, l)-summation: 7 a„ = lim 



where s n = Em=o a m- 



n=0 



s + si + • • • sn 
- lm r T — ; 

JV-s-oo TV + 1 



EXAMPLES 

(a) 1 — 1 + 1 — 1 + • • • = i (in the sense of Abel summation) 

(b) 1 — 1 + + 1 — 1 + + 1 — • • • = ! (in the sense of Cesaro summation) 



1 .3.8 OPERATIONS WITH POWER SERIES 

Let y = a\x + a 2 a; 2 + 03a; 3 + . . . , and let z = z(y) = b\x + 62a; 2 + 63a; 3 + . . . . 



z{y) 


bo 


bi 


b-2 




V(l-2/) 


1 


a\ 


a\ + a 2 


a\ + 2aia 2 + a 3 


Vi + v 


1 




12 1 

— 8 a l ^ 2 a2 


13 1 1 

16 a l — 4 a l a 2 + 2 a 3 


(i + y)" 1/2 


1 




8 a l ~ 2 a2 


— Yg-af + faiC!2 — \oz 




1 


ai 


^a 2 + a 2 


\a\ + aia 2 + a 3 


log(l + y) 





ai 


a 2 - ^a 2 


a 3 - aia 2 + |af 


siny 





ai 


0.2 


-|af + a 3 


cosy 


1 





-\o\ 


— aia 2 


tany 





ai 


02 


|af + a 3 



1 .3.9 MISCELLANEOUS SUMS AND SERIES 

1- £Li(-l)* +1 ^' = i(-l)" +1 I^(n + 1) + (-1)"^] 
9 1 _ i_ 1 

L-,k=\ k(k+l)(k+2) — 4 2(n+l)(n+2) 



3- E 



km 



A=l (k+m)\ (m-1)! (m+n)! 
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A \^ 2n ( — 1\ k C 2n> \ _1 — 2 "+! 
2-,*=0V ^ Ui — n+1 

J - Z^fc=0 I m+n ) ~ \ m ) 

6 - E£=d sech2 w = w csch2 w - csch2 x 

7- £^o(-l)*co S «f = ^r, EL O sec^ = 0, (M n/2) 

8 - E£L-«, (/b+aK/b+t) = 5=J [cot(Tra) - cotfrfc)] 

q 1 1 _|_ 7T sinh(airV2)-\-sin(air-\/2) 

— cos(a7rV / 2) 

in V°° * — 1 L 

iu - 2-<A=l e 27rk -l ~ 24 8tt 

1 1 - - 1 

LL - 2^k=0 k(k+l) — 1 

i ~ ^OO 1 1 



A(A+l)(A+2) 4 



i:> - Z^fc=0 k(k+\)(k+2)(k+Z) ~ 18 

14 V°° 1 - _J_ 

Z^fc=0 k(k+\)-(k+p) ~ p-p\ 



x i 

15. The series > — — — — — converges to 38.43. . . so slowly that it re- 

k log K(log log k) 

quires 10 3141 ° 86 terms to give two-decimal accuracy 



16. The series > — — — — diverges, but the partial sums exceed 10 only 

£^ fclogfc(loglogfc) 

after a googolplex of terms have appeared 
17- EZi ( -^if = |[l-ln2 + 7 rsech(7r^/2)] 



1.3.10 INFINITE SERIES 
1.3.10.1 Algebraic functions 

(x + y) n =x n + Q x n -'y + Q x n ~ 2 y 2 + .... 

(l±xT = l± Qx + {^jx 2 ± Qz 3 + . . . , (x 2 < 1). 

(1 ± *)"" = 1 =F Qx+ (" + y> t (" 3 2 )- 3 + • • • , (* 2 < I)- 

7rT ^= 1 + r-r 2 + ^ 3 -l| a;4 + ---' (a;2<1) - 
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(1 +x)~ 1/2 = 1 - y- -x 



3 n 5 q 35 a 

x 3 + —x 4 + 



16 128 

(1 ± x) -1 = lfi + i 2 fi 3 +i 4 ^i 5 + ..., 

(1 ± x)" 2 = 1 T 2x + 3x 2 T 4x 3 + 5x 4 T 6x 5 + 



(x 2 < 1). 

(x 2 < 1). 
(x 2 < 1). 



1.3.10.2 Exponential functions 



n 1 1 1 

2=1 + tt + ^-H ^ — r + 



1! 2! 



CO 



„n+l 



^— ' n!(x — n)(n + 1 — x) 

n—l \ > \ ' 



(all real values of x) 
(x not a positive integer) 



l + (x-a)+ y — + ■■■+'— ^ + 
a* = l + xlo g n+ {xl0g j a)2 +---+ {xl0g l a)n +- 



2! 



(all real values of x) 



1.3.10.3 Logarithmic functions 



logx 



log 



1 +x 

l-x 



x — 1 1 / x — 1 

1 — 

2 



a; 



X 



+ • 



1 / 1 \ n 
1 / x — 1 \ 



n \ x 



+ 



(* -1)- !(* -1)* + -1)3 



x — 1 1 / X — 1 

+ ' 



x + 1 1 3 v x + iy 5 U + i 



(x-a) (x - a) 2 (x - a) 3 
log a H — h 



2a 2 



3a 2 



io g (i + x ) = x -y + Y~^4 + 



\og(n + 1) = log(n - 1) + 2 
log(a + x) = log a + 2 



1 1 1 

n + 3^ + 5^ + 



1 

+ - 



2a + x 3 V 2a + x 



1 

+ T 



5 V2a + x 



^2,ti 1 

^ + y + --- + 2^T 



+ . 



(x > 1/2), 
(2 > x > 0), 
(x > 0). 

(0 < x < 2a). 
-1< x < 1. 



+ . 

(a > 0, —a < x). 
(-K x < 1). 
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1 .3.1 0.4 Trigonometric functions 



cos a; 



tana; 



cot x 



esc a; 



log sin x 
log cos x 
log tan a; 



sin a; 



3^7 
X X X 

X ~ 3l" + 5T " 7T + 



1 "2! + ¥ 



6! 



+ 



x 3 . 2a; 5 . . (-l)«-i2 2 «(2 2 « - l)B 2n 2n _, 



a; + y + — + ...51+ 



(all real values of x). 
(all real values of x). 
+ ... 



{2n)\ 

(x 2 < 7r 2 /4, B n is the n th Bernoulli number). 



1 a; a; 3 2a; 5 x 7 
x~ 3 ~ 45 ~ 945 ~ 4725 



sec a; = 1 + — + — x + 
2 24 



61 



-a; + 



(2n)! 

(a; 2 < tt 2 , B n is the n th Bernoulli number). 
277 a 



720 ' 8064 "' (2n)\ 

(x 2 < 7r 2 /4, E n is the n th Euler number). 



1 x 7a; 3 31a; 5 (_i)«+i2(2 2n " 1 

— I 1 1 h . . . +- - 

i 6 360 15120 



1 + a; + 



a; 

y 

a; 2 



1 + x+ — + 



x 4 


a; 6 






180 


2835 






X 6 


17a; 6 






45 


2520 






7a; 4 
90 


62a; 6 
+ 2835 


+ 




3x 4 


8x 5 




3a; 6 


4! 


5! 




6! 


4a; 4 


31a; 6 


+ 




~41~ 


6! 


-) 


3a; 3 


9a; 4 
+ 1T 




37a; 5 


" ~3T 


+ 


5! 



{2n)\ 

(\x\ < tt, B n is the n th Bernoulli number). 

(a; 2 < tt 2 ). 
(a; 2 < tt 2 /4). 
(a; 2 < tt 2 /4). 



+ 



56a; 7 



7! 



+ . 



(a; 2 < tt 2 /4). 



. . (x - a) 2 . (x — a) 3 
sin a + (x — a) cos a — sin a- 



2! 



3! 



cos a + . 
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1 .3.1 0.5 Inverse trigonometric functions 



. _i 1 , 1-3 , 1-3-5 7 

sm - x = x + — x + j^x + J^~7 X + 



(x 2 < 1, -f < sin" 1 a; < f). 



COS X 



1 • 3 



x H x + 

2 \ 2-3 2-4-5 '2-4-6-7 



:X a + 



1-3-5 7 



x' + 



(x 2 < 1, < cos -1 a; < w). 



tan 1 a; = x 



cot 1 a; 



X 3 




X 5 


X 7 




+ 






Y 


T 


-y + 


i 


+ 


i 


i 


a; 


3^" 


5a; 5 



+ 



7T 1 J_ 1 1 

2 a; 3a; 3 5a; 5 7a; 7 

7T X X X 

2-" + y-y + y-"' 



(x 2 < 1), 
(a; > 1), 
(x < -1). 

(x 2 < 1). 



1.3.10.6 

sinhx = 
sinh ax = 

coshx = 
cosh ax = 

tanhx = 



Hyperbolic functions 



3 ^ 7 

X X X 

X+ 3! + 5! + 7! + 



■ sinh 7ra 



smx 



x (2n+l) 

(2,/ + n: " ■■■■ 

2 sin 2x 3 sin 3x 



2 4 fi 

X X X 

1+ 2! + 4! + 6! + 



a 2 + l 2 a 2 + 2 2 a 2 +3 2 

2n 



X 

+ (2n)I + 



2a . 

— sinh 7ra 

7T 



1 

2^ 



cos x cos 2x 
+ 



cos 3x 



+ 1 2 a 2 +2 2 a 2 +3 2 



+ . 



1 3 2 5 
X- -x d + — X 5 - • 

3 15 

1 - 2e- 2x + 2e~ 4x 

1 



2 2 ™(2 2 ™ 



+ 



(2n) 



r^ix 2 "-^. 



2e 



-6a; 



+ 



2x 



(f) +* 



+ 



cothx 



2 C37T 

1 x x 3 2x 5 
x + 3~45 + 945 + 



+ 



(^) +x 2 (f) +x 2 



+ . 



+ 



2 2 ™B 



(2n) 



'"x 2 "-^ 



1 + 2e 



-2x 



+ 2e~ 4x + 2e 



-6x 



+ 



1 



-+2x 



tt 2 +x 2 (2tt) 2 +x 2 (3tt) 2 +x 2 



+ . 



(|x| < 7T). 



(|x| < 7T). 

(M < tt/2), 
(Re x > 0), 



(0 < |x| < 7T), 

(Re x > 0), 
(Re x > 0). 
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sech 



1 1 2 , 5 
1-2,* 



4!' 



61 6 , , ^2n i n 



(\x\ < 7r/2, E n is the n th Euler number), 



2 (e - * - e~ 3x + e~ 5x - e~ lx 



+ ...) 



47T 



1 



tt 2 + 4a: 2 (3tt) 2 + 4x 2 (5tt) 2 + 4a; 2 



+ 



csch 



I_*+Z^ + 2(2 2 " -1 -l)5 2 „ 
a; 6 360 (2n)! 
2 (e - * + e -3 * + e~ 5x + e~ lx + . . .) 
1 2a; 2a; 2a; 



x ir 2 +x 2 (2tt) 2 + a; 2 (3tt) 2 + a; 2 

r (n — 2) 
sinhnw = sinhw |^(2 coshw)™ -1 — — (2 cosh u) 

+ (n-3)(n-4) (2cQshMr _ 5 



\n-3 



2! 

(n-4)(n-5)(n-6) 
3! 



(2 cosh u)™ -7 + 



(Re x > 0), 

(0 < \x\ < tt), 
(Re x > 0), 



cosh nu = ^ [(2 cosh m)"-^ (2 cosh m)"" 2 + ^^(2 cosh u) n ~ 4 



i(n - 4)(n - 5) 
3! 



(2coshu)™ -6 + . 



1.3.10.7 

sinh -1 x - 

cosh -1 x - 
csch -1 x - 

sech -1 x - 
tanh -1 x - 
coth -1 x - 
gdx - 



Inverse hyperbolic functions 



l 



1 • 3 



1-3-5 



2-3 2-4-5 2-4-6-7 
, ,„ , 1 1 1-3 1 1-3-5 1 

l0g(2a;) + 2-2^ + ^4-4^ + 2^6-6^ + 
, /o \ 1 1 1-3 1 
l0g(2a;) -2-2^-2-4-4^ + - 
1 1 1 1-3 1 1-3-5 1 

+ . 



x 2 3a; 3 2 • 4 5a; 5 2 • 4 • 6 7a; 7 

, 2 la; 2 1-3 x 4 1 • 3 • 5 x 6 

log - + - • • 1 • — 

6 a; 2 2 2-4 4 2-4-6 6 

2 la; 2 1-3 x 4 1-3-5 x^_ 

° S x ~ 2 ' T ~ 2~4 ' T ~ 2-4-6 ' ~6~ 



3^7 
X X X 

x + — + — + — + ••• + 

3 5 7 

1 111 

x 3a; 3 5a; 5 7a; 7 



x 



2n+l 



2n + l 
■ + 



+ 



1 



1 3 1 5 

6 X + 24* + 



+ 



(2n + Vfx 2 ^ 1 
2 " a; 2n+1 +... 



+ 



(2n + l)! 



(\x\ < 1 
(\x\ > 1 
(x > 1 

(M > 1 
(0 < x < 1 
(0 < a; < 1 

(M < i 
(\x\ > i 

(M < i 
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1.3.11 INFINITE PRODUCTS 

For the sequence of complex numbers {a k}, an in nite product is n*^i(l + a k)- 
A necessary condition for convergence is that lim„_ i . 00 a n = 0. A necessary and 
suf cient condition for convergence is that JZfcLi l°g(l + a k) converges. Examples: 

<»> zi = n 1 t^t- 

A=l * 

00 

(b) sin z = z JJ cos ^ 

(c) sin(a + z) = (sin a) f j ( 1 H ^— | 

A=0,±l,±2,... v 7 

OO ✓ 

(d) cos(a + z) = (cos a) j j I 1 + 

A=±l,±3,±5,... ^ 



2z 



2a + kit 



00 / z 2\ 00 / 4z 2 \ 

(e) sin irz = irz J[ \ l - — J (f) cos ttz = J] ^1 - (2fc _ 1)2 j 

(g) sinh , = ,n^i + _j (h) cosh z = n (1 + {2k + 1)%2 



1 .3.1 1 .1 Weierstrass theorem 



w 2 w' 



De ne E{w,m) = (1 - w) exp I w + — + ••• H j . For k = 1,2,... let {6^} 

be a sequence of complex numbers such that \bk\ — > 00. Then the in nite product 

P( z ) = E ( t~i k j is an entire function with zeros at bu and at these points 

only. The multiplicity of the root at 6„ is equal to the number of indices j such that 
6j = b n . 



1.3.12 INFINITE PRODUCTS AND INFINITE SERIES 

1. The Rogers-Ramanujan identities (for a = or a = 1) are 

n k 2 + ak 



1 



?=i (l-g)(l-g2)... (1 _g*) 



II (1 _ g5j+a+l)(l _ g 5j-a+4) ' (1.3.8) 
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2. Jacobi's triple product identity is 

CO CO 

q^x k = \\{l- q j ){l+ X - 1 q>){l+xq j - 1 ). (1.3.9) 

A;— -co j— 1 

3. The quintuple product identity is 

CO 

J^J (1-3.10) 

CO 

= - ^'X 1 +x- 1 q j )(l + xq j - 1 )(l + x- 2 q 2j - 1 )(l+x 1 q 2j - 1 ). 



1.4 FOURIER SERIES 

If f(x) is a bounded periodic function of period 2L (that is, f(x + 2L) = f{x)) and 
satis es the Dirichlet conditions, 

1. In any period, f(x) is continuous, except possibly for a nite number of jump 
discontinuities. 

2. In any period f(x) has only a nite number of maxima and minima. 
Then f(x) may be represented by the Fourier series, 

OO 

f( x ) = Y + 1^ [ an cos ~JT + bn sm ~JTJ ' (lAl ) 

n=l 

where {a„} and {&„} are determined as follows: 

1 f a+2L ^ ^ , ^ 
a n = y j (x) cos —— dx torn = 0, 1,2, ... , 

' f{x) cos ^ tic, (1.4.2) 



r a+2L 



rnrx 
cos —— dx; 



b n = — / /(a;) sin — p- <ix forn = 1,2,3 



L 

2L 



i r 

- J ^f(x)sin—j-dx 



sin^cfe, (1.4.3) 
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where a is any real number (the second and third lines of each formula represent 
a = and a = — L respectively). 

The series in Equation (1.4.1) will converge (in the Cesaro sense) to every point 

f( x +) + f(x~) 

where f(x) is continuous, and to (i.e., the average of the left hand 

and right hand limits) at every point where f(x) has a jump discontinuity. 



1.4.1 SPECIAL CASES 

1. If, in addition to the Dirichlet conditions in Section 1.4, f(x) is an even func- 
tion (i.e., f(x) = f(—x)), then the Fourier series becomes 

oo 

ao ■s—^ rnrx 



/(*) = y + z2 anCos — ■ (1A4) 



That is, every b n = 0. In this case, the {a n } may be determined from 

I TI7TT 

/ f(x) cos — - — dx n = 0,1,2,.... (1.4.5) 
Jo L 



If, in addition to the above requirements, f(x) = —f(L — x), then a n will be 
zero for all even values of n. In this case the expansion becomes 

f( x ) = 2^ a2m -! cos 1 — • (1A6) 

m— 1 

2. If, in addition to the Dirichlet conditions in Section 1 .4, f(x) is an odd function 
(i.e., f(x) = — /(— #)), then the Fourier series becomes 

oo 

/(*) = 5>sin^. (1.4.7) 

n=l 

That is, every a n = 0. In this case, the {b„ } may be determined from 

2 71 7T T 

K= Lj f( x )s™ — dx n = 1,2,3,.... (1.4.8) 

If, in addition to the above requirements, f(x) = f(L — x), then b n will be 
zero for all even values of n. In this case the expansion becomes 

v , . (2m - l)nx 
f(x) = 2_ hm-i sin . (1.4.9) 

m—l 

The series in Equation (1.4.6) and Equation (1.4.9) are known as odd harmonic 
series, since only the odd harmonics appear. Similar rules may be stated for even 
harmonic series, but when a series appears in even harmonic form, it means that 2L 
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has not been taken to be the smallest period of f(x). Since any integral multiple of 
a period is also a period, series obtained in this way will also work, but, in general, 
computation is simpli ed if 2L is taken as the least period. 

Writing the trigonometric functions in terms of complex exponentials, we obtain 
the complex form of the Fourier series known as the complex Fourier series or as the 
exponential Fourier series. It is represented by 

oo 

f( x )= c ^ iUnX ( 1A1 °) 

n— — oo 

T17T 

where cu n = — for n = 0, ±1, ±2, . . . and the {c n } are determined from 

c n = J(x)e- i ^ x dx. (1.4.11) 

The set of coef cien ts {c„} is often referred to as the Fourier spectrum. 



1.4.2 ALTERNATE FORMS 

The Fourier series in Equation (1.4.1) may be represented in the alternate forms: 

1. When^<„ = tsxT 1 (- a n lb n ), a n = c n sm(f> n ,b n = -c n cos(f> n , 
and c„ = + b\, then 

oo 

f{x) = y + J2 C n Sin (— + <i>n) ■ (1-4.12) 

2. When (f> n = taxi' 1 (a n /b n ), a n = c n siii(f> n , b n = c n cos(f> n , 
and c„ = y^a n + b n , then 

oo 

f(x) = -j- + J2 c n cos + ■ (1-4.13) 



1.4.3 USEFUL SERIES 



4 

(a) 1 = - 

7T 



. isx 1 . 37ra; 1 . hisx 

sin — + - sm — h - sin — h 

L 3 Lb L 



(b) x 



2L 

7T 



TTX 



sm • 



1 . 2irx 1 . 3irx 
_ sm _ + _ sm _ + 



L 4L 
(c) x = - 



cos • 



1 3ttx 
3^ C0S — 



1 5ttx 



(0 < x < L) 
(-L < x < L) 
(0 < x < L) 
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(d) x 2 



(e) x 2 



2L 2 



7T 4\ . TTX 7T . 2lTX (IT 2 4 \ . 3lTX 



4L 2 



TT . AtTX ( TT 4 \ . 57TX 

T sm — + sm — 



7r:r 1 27rx 1 37ra; 1 
cos ___ cos _ + _ cos ___ cos _ + 



(0 


TT 




1 




1 
















4 " 




5 




7 + ' 




(g) 


TT 2 






1 


1 








+ 






+ 


6 






32 


+ Y 


(h) 


TT 2 






1 


1 




8 


-4 


+ 


52 


+ Y 2 


+ 



(0 < x < L) 
Attx 
(-L < x < L) 



211-1 + 1-1 

2 2 3 2 4 2 



■> 1 1 1 1 

° l 2 2 ~ + 4 2 ~ + 6 2 ~ + 8 2 ~ + 



1 .4.4 EXPANSIONS OF BASIC PERIODIC FUNCTIONS 

(a) f{x) 



c 2 ( — 1) • n7rc mrx 

— H > sm — — cos — — 

L 7r ^ n L L 



fix) 

A 



(b) / x = - \ -sm — 
tt *— ' n L 

n=l,3,5,... 



(c) / x = - \ i i- cos — - 1 sm — — 

7r n \ L J L 



(d) /(x) = jj2 



2 v— 1 • n7r sin(n7rc/2L) . n7rx 

2 nnc/2L L 
n=l ' 



1 












L 


► 

2L x 



/« 

A 

L/c 

L/C 





c 






irj i-r 



J 00 ., 

, . „, . 4 v 1 . nir . . mrx 

(e) j[x) = — > — sm — smn7ra sm 

' tt ^— ' n 4 /. 



./'(A ) 

A 

1 - ■ 
— ■ 
-1 - 



►I c 
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(f) fix) 



1 1 * 1 . nirx 
- > -sin — - — 

-7T ' T7 T, 



2 7r ^— ' n 

n=l 



(g) /<*) = | - £ E 



1 n-KX 
— cos — — 

n 1 L 




00 /(*) 



l + o 2 



tt 2 (1 - a) ^ 



oo 1 

El r . H . n ^-i TITT X / c \ 

— [( — 1) COS TITTO, — 1J COS — - — \ a = 2L> 



fix) 
i 

1 




(i) fix) 



2 tt 2 (1 -2a) ^ 



El n7ra 
— cos nna cos 
T7 2 T, 



./(.,' 

A 















2L 





2L - c/2 2L 



a) /(*) = - E 



2 ^ 



1 + 



n7r(l — a) 




(k) /(x) = - f2 



(-1)" 



, , ! + (-!)" . 

1 "I 7^ 7TT sm n7ra 

n7r(l — 2a) 



./(A) 
i 

1 


- 1 



1 


*H c/2 












2L - c/2 ! 


c/2 


L 


./ 2l r 



7T — * 



2 ^ , 



sm 

7r * — ' n L 

n=l 



./ID 



1 








L 


2L 







(m) /(x) 



E 



(-1) 



(n-l)/2 



L 


1 




3L/2 
1 








L/2 






^2L 
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(n) f{x) 



(o) fix) 



(P) /(*) 



9 v-^ 1 . nn . nirx 

— > — sm — sin 

7T 2 t— 1 n 2 

n=l 



3 L 



32 1 . n-K . nnx 
4 L 



— sm — si.it ■ 



37T 2 ' n 2 

n = l 



1 1 

1- — sm wt ■ 

7T 2 



2 1 

7T er* n 2 - 1 



cos mot 



5L/3 2L 





sin cor r = 2jr/co 



1 .5 COMPLEX ANALYSIS 



1.5.1 DEFINITIONS 

A complex number z has the form z = x + iy where x and y are real numbers, and 
i = y/— 1; the number i is sometimes called the imaginary unit. We write x = Re z 
and y = Im z. The number a; is called the real part of z and y is called the imaginary 
part of a. This form is also called the Cartesian form of the complex number. 

Complex numbers can also be written in polar form, z = re' e , where r, called 

the modulus, is given by r = |2| = yj x 2 + y 2 , and 6 is called the argument: 6 = 
axgz = tan -1 % (when x > 0). The geometric relationship between Cartesian and 
polar forms is shown below 



z = x + iy = re'' 
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The complex conjugate of z, denoted z, is de ned as J = x — iy = re ~ l ° . Note 
that \z\ = \z\, &rgz = —sxgz, and \z\ = y/zJ. In addition, z = z, z[ + z 2 = 
zi + z 2 , and J1Z2 = z{z 2 . 



1 .5.2 OPERATIONS ON COMPLEX NUMBERS 

1 . Addition and subtraction: 

zi±z 2 = (xi + iyi) ± (x 2 + iy-i) = (xi ± x 2 ) + i(yi ± y 2 )- 

2. Multiplication: 

ziz 2 = (xi + iyi)(x 2 + iy 2 ) = (xix 2 - yiy 2 ) + i(xiy 2 + x 2 yi) = nr 2 e %(01+02 



\ZlZ 2 \ 






\Z2 |, 


Division: 








Zl 




z{z 2 




z 2 




z 2 z 2 




Zl 




Nil 




z 2 






Powers: 






z n = 


r n e 


in6 


_ r n 



r 2 



Zl 



ar S I ~ ) = &T &Zi - &rgz 2 = f 1 - f 2 - 



5. Roots: 



z l/n = r l/n e i(e + 2k v )/n = r l/n ( cog + i S i n ■ 

n n 
for k = 0, 1, . . . , n — 1. The principal root has — tt < 9 <tt and fc = 



2&7T . . + 2kn 



1 .5.3 FUNCTIONS OF A COMPLEX VARIABLE 

A complex function 

w = f(z) = u(x,y) +iv(x,y) = \w\e l<t> , 

where z = x + iy, associates one or more values of the complex dependent variable 
w with each value of the complex independent variable z for those values of z in a 
given domain. 

A function f(z) is said to be analytic (or holomorphic) at a point zq if f(z) is 
de ned in each point z of a disc with positive radius R around zq, h is any complex 
number with \ h\ < R, and the limit of [f(zo+h)—f(zo)]/h exists and is independent 
of the mode in which h tends to zero. This limiting value is the derivative of f(z) 
at zo denoted by f'(zo). A function is called analytic in a connected domain if it is 
analytic at every point in that domain. 

A function is called entire if it is analytic in C. 

Liouville 's theorem: A bounded entire function is constant. 
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EXAMPLES 

1. f(z) = z n is analytic everywhere when n is a non-negative integer. If n is a negative 
integer, then f(z) is analytic except at the origin. 

2. f(z) = ~z is nowhere analytic. 

3. f(z) = e z is analytic everywhere. 



1.5.4 CAUCHY-RIEMANN EQUATIONS 

A necessary and suf cient condition for f(z) = u(x, y) + iv(x, y) to be analytic is 
that it satis es the Cauchy-Riemann equations, 

du dv , du dv ,„ _ „ s 

7T = 7T> and 7T = ~1T- (L5 - !) 
ox oy oy ox 



1 .5.5 CAUCHY INTEGRAL THEOREM 

If f(z) is analytic at all points within and on a simple closed curve C, then 

/ f(z)dz = 0. (1.5.2) 
Jc 

1 .5.6 CAUCHY INTEGRAL FORMULA 

If f(z) is analytic inside and on a simple closed contour C and if zq is interior to C, 
then 



/(*) 



dz. (1.5.3) 



Moreover, since the derivatives f'(zo), f"(zo), ... of all orders exist, then 



2m J c (z - z ) n+i 



1 .5.7 TAYLOR SERIES EXPANSIONS 

If f(z) is analytic inside of and on a circle C of radius r centered at the point zq, 
then a unique and uniformly convergent series expansion exists in powers of (z — z o) 
of the form 



n=0 

where 



f( z ) = ^2 a n(z - z ) n , \z-z \<r, z ^oo, (1.5.5) 
n! 2m J c (z - z ) n+i 
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If M(r) is an upper bound of \f(z) | on C, then 

\a n \ = -Af {n) (z )\<^P- (Cauchy's inequality). (1.5.7) 



If the series is truncated with the term a n (z — zo) n , the remainder R n (z) is given by 

)n+l 

2iri J c (s - z)(s - z y 

and 



27H y c (s - z)(s - 2; )™ +1 



r / r- z-z 



1 .5.8 LAURENT SERIES EXPANSIONS 

If f(z) is analytic inside the annulus between the concentric circles C\ and Ci cen- 
tered at zo with radii ri and r 2 (r\ < r 2 ), respectively, then a unique series expansion 
exists in terms of positive and negative powers of z — zq of the following form: 

oo oo 

f(z) = V b n (z - z )~ n + V a n (z - z ) n 

ti ti> (1-5. 10) 

= h t H h a + ai (z - z ) + a 2 (z - z ) + .. . 

(z - Zq) 1 z- Zq 

with (here C is a contour between C\ and C 2 ) 

/(«) 



c(s _, o) n +1 ^ n = 0.1,2, 



b n = ^-. jj{s){s-z ) n - l ds, n = l,2,3, 



(1.5.11) 



'c 

Equation (1.5.10) is often written in the form 

oo 

f(z)= Cn(z-z ) n forn < \z-z \ <r 2 (1.5.12) 

n— — oo 

with 

c„ = — / - — ^ — forn = 0,±l,±2 (1.5.13) 

2m J c (z - z )™ +1 

1 .5.9 ZEROS AND SINGULARITIES 

The points z for which /(z) = are called zeros of f{z). A function f(z) which is 
analytic at zq has a zero of order to there, where to is a positive integer, if and only 
if the rst to coef cients do, a\ , . . . , a m _i in the Taylor expansion at zo vanish. 

A singular point or singularity of the function f(z) is any point at which f(z) 
is not analytic. An isolated singularity of f(z) at zo may be classi ed in one of three 
ways: 
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1 . A removable singularity if and only if all coef cien ts b n in the Laurent series 
expansion of f(z) at zo vanish. This implies that f(z) can be analytically 
extended to zq. 

2. A pole of order to if and only if (z — zo) m f(z), but not (z — zo)" 1-1 f(z), is 
analytic at zq (i.e., if and only if b m ^ and = 6 m +i = fe m +2 = . . . in the 
Laurent series expansion of f(z) at zq). Equivalently, f(z) has a pole of order 
to if 1// (z) is analytic at zo and has a zero of order to there. 

3. An isolated essential singularity if and only if the Laurent series expansion of 
f(z) at zo has an in nite number of terms involving negative powers of z — zq. 

Theorems: 

Riemann removable singularity theorem Suppose that a func- 
tion / is analytic and bounded in some deleted neighborhood < \z — 
zq\ < e of a point zq. If / is not analytic at zq, then it has a removable 
singularity there. 

Casorati-Weierstrass theorem Suppose that z is an essential 
singularity of a function /, and let w be an arbitrary complex number. 
Then, for any e > 0, the inequality \f(z) — w\ < e is satisi ed at some 
point z in each deleted neighborhood < \z — zq\ < 5 of zq. 



1.5.10 RESIDUES 

Given a point zq where f(z) is either analytic or has an isolated singularity, the 
residue of f(z) is the coef c ient of (z — zo) -1 in the Laurent series expansion of 
f(z) at z , or 

Res(^o) = h = -L / f(z) dz. (1.5.14) 

If f(z) is either analytic or has a removable singularity at zq, then b\ = there. If 
zo is a pole of order to, then 



(1.5.15) 



For every simple closed contour C enclosing at most a nite number of singularities 
z\ , zi , . . . , z n of a function analytic in a neighborhood of C, 

n 

/ f(z)dz = 27ri^Res(^), (1.5.16) 
■' c k=i 

where Res(zt) is the residue of f(z) at zu- 
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1 .5.1 1 THE ARGUMENT PRINCIPLE 

Let f(z) be analytic on a simple closed curve C with no zeros on C and analytic 
everywhere inside C except possibly at a nite number of poles. Let Ac sxgf(z) 
denote the change in the argument of f(z) (that is, nal value — initial value) as z 
transverses the curve once in the positive sense. Then 

J-A c arg/(^) = -i T / lM dz = N-P, (1.5.17) 

where N is number of zeros of f(z) inside C, and P is the number of poles inside C. 
The zeros and poles are counted according to their multiplicities. 

1.5.12 TRANSFORMATIONS AND MAPPINGS 

A function w = f(z) = u(z) + iv(z) maps points of the z-plane into corresponding 
points of the w-plane. At every point z such that f(z) is analytic and f'(z) ^ 0, 
the mapping is conformal, i.e., the angle between two curves in the z -plane through 
such a point is equal in magnitude and sense to the angle between the corresponding 
curves in the w-plane. A table giving real and imaginary parts, zeros, and singu- 
larities for frequently used functions of a complex variable and a table illustrating a 
number of special transformations of interest are at the end of this section. 

A function is said to be simple in a domain D if it is analytic in D and assumes 
no value more than once in D. Riemann's mapping theorem states: 

If D is a simply-connected domain in the complex z plane, which is nei- 
ther the z plane nor the extended z plane, then there is a simple function 
f(z) such that w = f(z) maps D onto the disc \w\ < 1. 

1.5.12.1 Bilinear transformations 

The bilinear transformation is de ne d by w = GZ — , where a, b, c, and d are corn- 
er + a 

plex numbers and ad ^ be. It is also known as the linear fractional transformation. 

The bilinear transformation is de ned for all z ^ —d/c. The bilinear transformation 

is conformal and maps circles and lines onto circles and lines. 

—dw + b .... , .... 
The inverse transformation is given by z = , which is also a bilinear 

cw — a 

transformation. Note that w ^ a/c. 

The cross ratio of four distinct complex numbers zu (for k = 1, 2, 3, 4) is given 

by 

, (z 1 - z 2 )(z 3 - Za) 

(z 1 ,Z 2 ,Z 3 ,Za) = 7 T7 r. 

(Zi - Za)(Z 3 - z 2 ) 

If any of the zu 's is complex in nity , the cross ratio is rede ned so that the quotient 
of the two terms on the right containing zu is equal to 1. Under the bilinear transfor- 
mation, the cross ratio of four points is invariant: (w\, w 2 ,w 3 , Wa) = (zi,z 2 ,z 3 ,za). 

The Mobius transformation is special case of the bilinear transformation; it is 
de ned by w(z) = j5=^ where a is a complex constant of modulus less than 1. It 
maps the unit disk onto itself. 
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f(z) = w(x,y) 



u(x, y) = Re w(x, y) 



v(x,y) = lmw(x,y) 



Zeros (and order m) 



Singularities (and order m) 



z 
1 



z — (a + ib) 
a, b real 



sin z 
cos z 
sinh 2 
cosh z 

tan z 
tanh z 
log 2 



2 2 

x -y 

x 

x 2 + y 2 

2 2 

x -y 
(x 2 + y 2 ) 2 
x — a 



(x - a) 2 + (y - b) 2 



x + *Jx 2 + y 1 
2 

e" cos y 
sin x cosh y 

cos x cosh y 

sinh x cos y 

cosh £ cos y 

sin 2a: 
cos 2a; + cosh 2y 

sinh 2a 
cosh 2a + cos 2y 

ilog(a 2 + 2 / 2 ) 



1/2 



y 

2xy 



-y 



x 2 + y 2 

-%xy 

(a 2 + y 2 ) 2 

-jy-b) 

(a - a) 2 + (y- b) 2 



• + -i/a 2 + y 1 



e sin y 
cos a sinh y 

— sin a sinh y 

cosh a sin y 

sinh a sin y 

sinh 2y 
cos 2a + cosh 2y 

sin 2y 
cosh 2a + cos 2y 



tan" 1 - + 2kir 

(fc = 0,±l,±2 ) ...) 



1/2 



« = 


0, m = 1 


Pole (m 


= 1) at z = 


oo 


« = 


0, m = 2 


Pole (m 


= 2) at z = 


oo 


« = 


oo, m = 1 


Pole (m 


= 1) at z = 





« = 


oo, m = 2 


Pole (m 


= 2) at z = 





z = 


oo, m = 1 


Pole (m 


= 1) at z = 


a + 



z = 0, m = 1 
None 

« = m = 1 
(/c = 0,±1,±2,... 
2 = (/c + l/2)7r, m 
(A = 0,±1,±2,... 
2 = kni, m = 1 
(Jfc = 0,±l,±2,... 
z = (k + l/2)m, m 
(k = 0,±1,±2,. 

z = kn, m = 1 
(jt = 0,±1,±2,. 

z = kni, m = 1 
(fc = 0,±1,±2,. 

z = 1, m = 1 



Branch point (m = 1) at 2 = 
Branch point (m = 1) at z = 00 
Essential singularity at z = 00 
Essential singularity at 2 = 00 

Essential singularity at 2 = 00 

Essential singularity at 2 = 00 

Essential singularity at 2 = 00 

Essential singularity at 2 = 00 
Poles (m = 1) at 2 = (Jfc + 1/2)tt 
(fc = 0,±l,±2,...) 

Essential singularity at 2 = 00 
Poles (m = 1) at 2 = (k + 1/2)7™ 
(fc = 0,±1,±2,...) 
Branch points at 2 = 0, 2 = 00 



1 .5.1 2.2 Table of transformations 
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1.5.12.3 Table of conformal mappings 

In the following functions z = x + iy and w = u + iv = pe %< ^ . 
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14. 





D 


y 

F \ 




c( 






A G' 




i 




1 x 




D 








Z - a _ 1 + xix 2 + - x 2 )(l - a;|) _ 



oz — 1 xi + X2 

_ 1- Xl x 2 + V(l -gj) 
ito — 

£1 - £2 

(a > 1 and i? > 1 when — 1 < £2 < £1 < 1). 



15. 




-^0 



az — 1' x\ + x-2 

_ xix 2 - 1 - a/(x 2 - l){x\ - 1) 
a?i - X2 



16. 



17. 



(X2 < a < x\ and < Rq < 1 when 1 < xi < x{). 




y 
c 




V 






\b x E D' 


W = z + l/z 

C B' A' u 


E 


A 


1 1 


2 




y 




V 
















W = Z + 11 Z 

r » 


E D 


B A E' D' 


C B' A' 



18. 







y 






V 








c 






C 








F ^ 










D 








1 






E 


1 


k 


D' E' 


F' 


A' B' 



w = z + l/z; B'C'D 1 is on the 
ellipse 



ku 
fc 2 + 1 



+ 



kv 
k 2 - 1 



1. 
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y 


D' C 


V 

Jti £ 




19. 


El x 




w = log 

2 + 1 


A B 


C D E 


D' E' 


A' £" 




F' 


E' 


Hi 


D' 






A' B' 


ti 


C 

it 







z - 1 

w = log ; ABC is on the 

z + 1 

circle a; 2 + j/ 2 — 2j/ cot fc = 1. 



, s + 1 , • 
w = log ; relationship 

z — 1 

between centers and radii: centers 
of circles at z n = coth c„ , radii are 
cschc„, n = 1, 2. 



22. 





y 




D' 


V 

Ki 


C 








km 


A' B' 




i 


< 


G' 

it 


E F G 


A £ 


C D 


E' 


F' 



k 

w = k log + log 2(1 —k) + 

1 — k 

iTT — k\og(z + l) — (l — k) log(z — 1); 
xi=2k- 1. 



23. 







V 








C 












D' 


E' 


A' B 1 



w = tan 2 (z/2). 



G 

24. h 



w = coth(z/2). 



G 

25. h 



F It! £ S' 



I 



1*2 A' 



log coth(z/2). 
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y 


26. 


1 


A B 


C D E 





V 








D' C 




u 


A' 


ir 



w = iri + z — log z. 



27. 





y 


H 


■ 

X 


A 


B C 


D 


E 





.1 


V 














C 


B 


Ki 












u 


D 1 


E' 



w 



2( 2 + l) 1 /2 + l 0f 



(2 + I) 1 / 2 -1 
( z + l)i/a + r 







V 




V 


D 1 








71; 






28. 


2 


EH ^ 


It/i- 






u 




D E F 


ABC 




B' 


c 






F' 




A' 




















y 




V 




















29. 








ft 






El 


ra 




it 




A S 


C D 


c 


D' 



i , 1+ikt , 1+t 

w= k l0g T^ki + l0g —f 



w 



z-l\ 



1/2 



Z + 



k 2 J 



cosh" 1 *]. 



30. 





y 




1 k 


E 


F 


A L 


C D 



T 

It/A- 



w = cosh 



— ' T^osh" 1 



! ( 2z -k - 1 



fc - 1 
(fc + l)z-2fc 



(jfc - 1)* 



© 2003 by CRC Press LLC 



1 .6 INTERVAL ANALYSIS 



1. An interval x is a subset of the real line: x = [x_, x] = {z £ B, \ x_< z < x}. 

2. A thin interval is a real number: x is thin if x_ = x 

3. mid(a;) = 5. |x| = mag(x) = max \z\ 

4. rad(a;) = 6 ^ = mig^) = m in |z| 



1 .6.1 INTERVAL ARITHMETIC RULES 



Operation 


Rule 


x + y 


[x + y, x + y] 


a; — y 


[x-y,x-y\ 


xy 


[min (xy ,xy,xy, xy) , max (xy ,xy,xy, xy) ] 


x_ 

V 


Lin (M, Ml ,maxf£,l,I,ll)l ifO 4y 
L \y' y' y' y J ' \y , y , y_ , yj'\ ^ J 



EXAMPLES 



1. [1, 2] + [-2, 1] = [-1, 3] 3. [1, 2] * [-2, 1] = [-4, 2] 

2. [1,2] -[1,2] = [-1,1] 4. [1,2]/[1,2]= [|,2] 



1 .6.2 INTERVAL ARITHMETIC PROPERTIES 



Property 


+ and — 


* and / 


commutative 


x + y = y + x 


xy = yx 


associative 


x + (y + z) = (x + y) + z 


x(yz) = (xy)z 


identity elements 


0+x=x+0=x 


l*y = y*l = y 


sub-distributivity 


x(y ± z) C xy ± xz (equality holds if x is thin) 


sub-cancellation 


x — y C (x + z) — (y + z) 


X_ xz 

y — yz 


€ x — x 


1 G * 
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1.7 REAL ANALYSIS 



1.7.1 RELATIONS 

For two sets A and B, the product Ax Bis the set of all ordered pairs (a, b) where 
a is in A and b is in B. Any subset of the product i x Bis called a relation. A 
relation i? on a product Ax Ais called an equivalence relation if the following three 
properties hold: 

1. Reflexive: (a, a) is in R for every a in A. 

2. Symmetric: If (a, 6) is in R, then (6, a) is in R. 

3. Transitive: If (a, 6) and (6, c) are in i?, then (a, c) is in i?. 

When R is an equivalence relation then the equivalence class of an element a in A 
is the set of all bin A such that (a, b) is in i?. 

1. If \ A\ = n, there are 2™ 2 relations on A. 

2. If |^4| = n, the number of equivalence relations on A is given by the Bell 
number B n . 

EXAMPLE The set of rational numbers has an equivalence relation "=" de ned by the 
requirement that an ordered pair (f , §) belongs in the relation if and only if ad = be. 
The equivalence class of | is the set {|, |, |, . . . , 5f ; rf ; ■ ■ ■ }• 



1.7.2 FUNCTIONS (MAPPINGS) 

A relation / on a set X x Y is a. function (or mapping) from X into Y if (x, y) and 
(x, z) in the relation implies that y = z, and each x € X has aj £ 7 such that 
(x, y) is in the relation. The last condition means that there is a unique pair in / 
whose rst element is x. We write f(x) = y to mean that (x, y) is in the relation /, 
and emphasize the idea of mapping by the notation / : X — > Y . The domain of / is 
the set X . The range of a function / is a set containing all the y for which there is a 
pair (x, y) in the relation. The image of a set A in the domain of a function / is the 
set of y in Y such that y = f(x) for some x in A. The notation for the image of A 
under / is f[A]. The inverse image of a set B in the range of a function / is the set 
of all x in X such that f(x) = y for some y in B. The notation is / _1 [£]. 

A function / is one-to-one (or univalent, or injective) if f(x\) = /(a^) implies 
£1 = £2 ■ A function / : X — > Y is onto (or surjective) if for every y in Y there is 
some a; in X such that /(a;) = y. A function is bijective if it is both one-to-one and 
onto. 
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EXAMPLES 

1. f(x) = e x , as a mapping from E to E, is one-to-one because e xi = e X2 implies 
xi = X2 (by taking the natural logarithm). It is not onto because —1 is not the value of 
e x for any x in IK. 

2. g(x) = x 3 — x, as a mapping from E to E, is onto because every real number is attained 
as a value of g(x), for some x. It is not one-to-one because g(— 1) = g(0) = g(l). 

3. h(x) = x 3 , as a mapping from E to E, is bijective. 

For an injective function / mapping X into Y, there is an inverse function f _1 
mapping the range of / into X which is de ned by: f~ 1 (y) = x if and only if 

f(x) = y. 

EXAMPLE The function f(x) = e x mapping R into R + (the set of positive reals) is 

bijective. Its inverse is f~ 1 (x) = ln(x) which maps E + into R. 
For functions / : X — > Y and g : Y — > Z, with the range of / contained in the 
domain of g, the composition {go f): X — > Z is a function de ne d by (g o f)(x) = 
g{f{x)) for all x in the domain of /. 

1. Note that g a f may not be the same as / o g. For example, for f(x) = x + 1, 
and ff (a;) = 2x, we have (g°f)(x) = g(f(x)) = 2f(x) = 2(x + l) =2x + 2. 
However (/ o g){x) = f(g(x)) = g{x) + 1 = 2x + 1. 

2. For every function / and its inverse we have (/ o f~ 1 ){x) = x, for all 
x in the domain of and o f)(x) = x for all x in the domain of /. 
(Note that the inverse function, does not mean j). 



1 .7.3 SETS OF REAL NUMBERS 

A sequence is the range of a function having the natural numbers as its domain. It 
can be denoted by {x n \ n is a natural number} or simply {x n }. For a chosen natural 
number N, a. finite sequence is the range of a function having natural numbers less 
than N as its domain. Sets A and B are in a one-to-one correspondence if there is 
a bijective function from A into B. Two sets A and B have the same cardinality if 
there is a one-to-one correspondence between them. A set which is equivalent to the 
set of natural numbers is denumerable (or countably infinite). A set which is empty 
or is equivalent to a nite sequence is finite (or finite countable). 

EXAMPLES The set of letters in the English alphabet is nite. The set of rational num- 
bers is denumerable. The set of real numbers is uncountable. 

1 .7.3.1 Axioms of order 

1 . There is a subset P (positive numbers) of E for which x + y and xy are in P 
for every x and y in P. 

2. Exactly one of the following conditions can be satis ed by a number x in E 

(trichotomy): x € P, — x € P, or x = 0. 
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1.7.3.2 Definitions 

A number b is an upper (or lower) bound of a subset S in E if x < b (or x > b) for 
every x in S". A number c is a feasf upper bound (lub, supremum, or sm/?) of a subset 
S in E if c is an upper bound of S and b > c for every upper bound 6 of 5. A number 
c is a greatest lower bound (gib, infimum, or inf) if c is a lower bound of S and c > b 
for every lower bound b of S. 

1 .7.3.3 Completeness (or least upper bound) axiom 

If a non-empty set of real numbers has an upper bound, then it has a least upper 
bound. 



1.7.3.4 Characterization of the real numbers 

The set of real numbers is the smallest complete ordered eld that contains the ratio- 
nals. Alternatively, the properties of a eld, the order properties, and the least upper 
bound axiom characterize the set of real numbers. The least upper bound axiom 
distinguishes the set of real numbers from other ordered elds. 

Archimedean property o/ffi: For every real number x, there is an integer N such 
that x < N. For every pair of real numbers x and y with x < y, there is a rational 
number r such that x < r < y. This is sometimes stated: The set of rational numbers 
is dense in R. 



1.7.3.5 Definition of infinity 

The extension of K by oo is accomplished by including the symbols +oo and 
with the following de nition s (for all 



1 . for all x in " 

2. for all x in " 

3. for all x in '_ 

4. for all x in " 



— oo < x < oo 
x + oo = oo 



x - 
x 



00 



5. if x > then x ■ oo 



x 

-00 
00 



-00 







6. if x > then x ■ (— oo) 

7. oo + '00 = oo 

8. —oo — oo = —oo 

9. oo • oo = oo 

10. —oo • (— 00 ) = 00 



1.7.3.6 Inequalities among real numbers 

The expression a > b means that a — b is a positive real number. 

1 . If a < b and b < c then a < c. 

2. If a < b then a ± c < b ± c for any real number c. 
if c > then ac < be 
if c < then ac > be 

4. If a < b and c < d then a + c <b + d. 

5. If < a < b and < c < d then ac < bd. 

1 1 

I ab > I 

6. If a < b and < > then 
I ab < [ 



3. If a < b and 
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1.7.4 TOPOLOGICAL SPACE 



A topology on a set X is a collection T of subsets of X (called open sets) having the 
following properties: 

1 . The empty set and X are in T. 

2. The union of elements in an arbitrary subcollection of T is in T. 

3. The intersection of elements in a nite subcollection of T is in T. 

The complement of an open set is a closed set. A set is compact if every open 
cover has a nite subcover. The set X together with a topology T is a topological 
space. 

1.7.4.1 Notes 

1 . A subset E of X is closed if and only if E contains all its limit points. 

2. The union of nitely many closed sets is closed. 

3. The intersection of an arbitrary collection of closed sets is closed. 

4. The image of a compact set under a continuous function is compact. 



1.7.5 METRIC SPACE 

A metric (or distance function) on a set E is a function p: E x E -> E that satis es 
the following conditions: 

1. Positive definiteness: p(x, y) > for all x, y in E, and p(x, y) = if and only 
if x = y. 

2. Symmetry: p(x, y) = p(y, x) for all x, y in E. 

3. Triangle inequality: p(x, y) < p(x, z) + p(z,y) for all x, y, z in E. 

EXAMPLE The set of real numbers with distance de ned by d(x, y) = \x — y\ is a metric 
space. 

A S neighborhood of a point a; in a metric space E is the set of all y in E such that 
d(x, y) < S. For example, a S neighborhood of x in E is the interval centered at x 
with radius 6, (x — 6, x + S). In a metric space the topology is generated by the S 
neighborhoods. 

1 . A subset G of E is open if, for every x in G, there is a S neighborhood of x 
which is a subset of G. For example, intervals (a, b), (a,oo), (—00,6) are open 
in ffi. 

2. A number a; is a limit point (or a point of closure, or an accumulation point) 
of a set F if, for every S > 0, there is a point y in F, with y ^ x, such that 
\x-y\ < S. 

3. A subset F of E is closed if it contains all of its limit points. For example, 
intervals [a, b], (—00, b], and [a, 00) are closed in E. 
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4. A subset F is dense in E if every element of E is a limit point of F. 

5. A metric space is separable if it contains a denumerable dense set. For ex- 
ample, E is separable because the subset of rationals is a denumerable dense 
set. 

6. Theorems: 

Bolzano-Weierstrass theorem Any bounded in nite set of 
real numbers has a limit point in R. 

Heine-Borel theorem A subset of R is compact if and only if it 
is closed and bounded. 



1 .7.6 CONVERGENCE IN R WITH METRIC \x - y\ 
1 .7.6.1 Limit of a sequence 

A number L is a limit point of a sequence {x n } if, for every e > 0, there is a natural 
number N such that \x„ — L\ < e for all n > N. If it exists, a limit of a sequence 
is unique. A sequence is said to converge if it has a limit. A number L is a cluster 
point of a sequence {a;„} if, for every e > and every index N, there is an n > N 
such that \x„ — L\ < e. 

EXAMPLE The limit of a sequence is a cluster point, as in {i}, which converges to 0. 

However, cluster points are not necessarily limits, as in {(—1)"}, which has cluster 

points +1 and — 1 but no limit. 
Let {x n } be a sequence. A number L is the limit superior (limsup) if, for every 
e > 0, there is a natural number N such that x „ > L — e for in nitely many n > N, 
and x n > L + e for only nitely many terms. An equivalent de nitio n of the limit 
superior is given by 

lim sup x n = inf sup Xk ■ (1-7.1) 

N k>N 

The limit inferior (liminf) is de ned in a similar way by 

lim inf x„ = sup inf Xk- (1-7.2) 

N k > N 

For example, the sequence {x n } with x n = 1 + (—1)™ + has lim sup x n = 2, 
and lim inf x n = 0. 

Theorem Every bounded sequence {x n } in E has a limsup and 
a liminf. In addition, if lim sup a; n = lim inf x n , then the sequence 
converges to their common value. 

A sequence {x n } is a Cauchy sequence if, for any e > 0, there exists a positive 
integer N such that \x„ — x m \ < e for every n > N and m > N. 

Theorem A sequence {x n } in E converges if and only if it is a 
Cauchy sequence. 

A metric space in which every Cauchy sequence converges to a point in the space is 
called complete. For example, E with the metric d(x, y) = \x — y\ is complete. 
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1 .7.6.2 Limit of a function 

A number L is a limit of a function / as x approaches a number a if, for every e > 0, 
there is a 8 > such that \ f(x) - L\ < e for all x with < \x - a\ < S. This 
is represented by the notation \im x ^ a f(x) = L. The symbol oo is the limit of a 
function / as x approaches a number a if, for every positive number M, there is 
a 6 > such that f(x) > M for all x with < \x - a\ < 6. The notation is 
\im x ^ a f(x) = oo. A number L is a limit of a function / as x approaches oo if, for 
every e > 0, there is a positive number M such that \ f(x) — L\ < e for all x > M; 
this is written lim ;c _ ) . 00 f(x) = L. The number L is said to be the limit at infinity. 

EXAMPLES lim 3x - 1 = 5, lim \ = oo, lim - = 0. 

x— f2 x— fO X x— foo X 

1 .7.6.3 Limit of a sequence of functions 

A sequence of functions {f n (x)} is said to converge pointwise to the function f(x) 
on a set B if for every e > and x £ E there is a positive integer N such that 
\f(x) — f n (x)\ < e for every n > N. A sequence of functions {f n (%)} is sa id to 
converge uniformly to the function / on a set E if, for every e > 0, there exists a 
positive integer N such that \ f(x) — f n (x)\ < e for all x in E and n > N. 

Note that these formulations of convergence are not equivalent. For example, 
the functions f n {x) = x n on the interval [0, 1] converge pointwise to the function 
f(x) = for < x < 1, /(l) = 1. They do not converge uniformly because, for 
e = 1/2, there is no N such that |/„(x) - f(x)\ < 1/2 for all a; in [0, 1] and every 
n > N. 

A function / is Lipschitz if there exists k > in E such that \f(x) — f(y)\ < 
k\x — y\ for all x and y in its domain. The function is a contraction if < k < 1. 

Fixed point or contraction mapping theorem Let E be a 

complete metric space. If the function / : i? — > i? is a contraction, then 
there is a unique point x in E such that /(a;) = x. The point a; is called 
a fixed point of /. 

EXAMPLE Newton's method for nding a zero of f(x) = (x + l) 2 — 2 on the interval 
[0, 1] produces x n +i = g(x n ) with the contraction g(x) = f — | + ^y. This has 
the unique x ed point \pl — 1 in [0, 1]. 



1 .7.7 CONTINUITY IN R WITH METRIC |x - y| 

A function / : R — > R is continuous at a point a if / is de ned at a and 

lim /(re) =f(a). (1.7.3) 

The function / is continuous on a set E if it is continuous at every point of E. A 
function / is uniformly continuous on a set E if, for every e > 0, there exists a 6 > 
such that \f(x) — f(y)\ < e for every x and y in E with |x — y\ < S. A sequence 
{fn(x)} of continuous functions on the interval [a, b] is equicontinuous if, for every 
e > 0, there exists a S > such that |/„(x) — / n (?y)| < e for every n and for all x 
and y in [a, 6] with \x — y\ < S. 
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1. A function can be continuous without being uniformly continuous. For exam- 
ple, the function g(x) = ^ is continuous but not uniformly continuous on the 
open interval (0, 1). 

2. A collection of continuous functions can be bounded on a closed interval with- 
out having a uniformly convergent sub-sequence. For example, the continuous 
functions f n (x) = x 'i + ^\_ nx yi are each bounded by 1 in the closed inter- 
val [0,1] and for every x there is the limit: lim n _ ) . 00 fn(x) = 0. However, 
In (^) = 1 for every n, so that no sub-sequence can converge uniformly to 
everywhere on [0, 1]. This sequence is not equicontinuous. 

Theorems: 

Theorem Let {f n (x)} be a sequence of functions mapping E into 
E which converges uniformly to a function /. If each f n (x) is continu- 
ous at a point a, then f(x) is also continuous at a. 

Theorem If a function / is continuous on a closed bounded set E, 
then it is uniformly continuous on E. 

Ascoli-Arzela theorem Let K be a compact set in E. If {f n (x)} 
is uniformly bounded and equicontinuous on K, then {f n (x)} contains 
a uniformly convergent sub-sequence on K. 

Weierstrass polynomial approximation theorem Let K be 

a compact set in E. If / is a continuous function on K then there exists 
a sequence of polynomials that converges uniformly to / on K. 



1.7.8 BANACH SPACE 

A norm on a vector space E with scalar eld E is a function | - | from E into E that 
satis es the following conditions: 

1. Positive definiteness: \\x\\ > for all x in E, and ||a;|| = if and only if 
./• II. 

2. Scalar homogeneity: For every x in E and a in E, | \ax\ \ = \a\ \ \x\\. 

3. Triangle inequality: \ \x + y \ \ < \ \x\ \ + \ \y \ \ for all x, y in E. 

Every norm | - | gives rise to a metric p by de ning: p(x, y) = \\x — y\\. 
EXAMPLES 

1. E with absolute value as the norm has the metric p(x, y) = \x — y\. 

2. E x E (denoted E 2 ) with the Euclidean norm ||(a;, y)\\ = ^Jx 2 + y 2 has the metric 
p{{xi,yi), {x2,y 2 )) = VO^i -x 2 ) 2 + {yi -y 2 ) 2 - 

A Banach space is a complete normed space. 

A widely studied example of a Banach space is the (vector) space of measurable 
functions / on [a, b] for which \f(x) \ p dx < oo with 1 < p < oo. This is denoted 
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by L p [a, b] or simply L p . The space of essentially bounded measurable functions on 
[a, b] is denoted by L^a, b]. 

The L p norm for < p < oo is de ned by ||/|| = ( J a \f(x)\ p dx\ . The 
Loo norm is de ned by 

||/|| 00 =ess sup |/(a;)|, (1.7.4) 

a<x<b 

where 

ess sup |/(x)| =inf{M|m{* :/(*)> M} = 0}. (1.7.5) 

a<x<b 

Let {f n (x)} be a sequence of functions in L p (with 1 < p < oo) and / be some 
function in L p . We say that {/«} converges in the mean of order p (or simply in 
Lp-norm) to / if lim^oo ||/„ - f\\ p = 0. 

Riesz-Fischer theorem The L p spaces are complete. 

1.7.8.1 Inequalities 

1. Minkowski inequality If / and g are in L p with 1 < p < oo, then 
\\f + 9\\ p < ||/|| p + ||5|| p .Thatis, 

( fa ^ + ^ ~ {la + 1 - P < CX) ' 

(1.7.6) 

ess sup |/ + g\ < ess sup |/|+esssup \g\. 

2. Holder inequality If p and q are non-negative extended real numbers such 
that 1/p +1/(7=1 and / G L p and g G L„ then \\fg\l, < \\f\\ p \\g\\ q . That 
is 

Vp / . fc \ 1/9 

forl<p<oo, (1.7.7) 



f \fg\ < (esssup |/|) /" (1.7.8) 

a J a 

3. Schwartz (or Cauchy-Schwartz) inequality If / and g are in L 2 , then 
11/5 Hi < ll/IUM^- This is the special case of Holder's inequality withp = 
q = 2. 

4. Arithmetic mean-geometric mean inequality If A n and G n are the arith- 
metic and geometric means of the set of positive numbers {0,1,0,2, ■■■ ,a„} 
then A n >G n . That is 

ai+a 2 + ... + a„ , , 1/n 
> (aia 2 ■■■a n ) ,n 
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5. Carleman's inequality If A n and G n are the arithmetic and geometric 
means of the set of positive numbers {a i , a 2 , . . . , a n } then 

n 

G r < neA n . 



1.7.9 HUBERT SPACE 

An inner product on a vector space E with scalar eld C (complex numbers) is a 
function from E x E into C that satis es the following conditions: 

1. (x, x) > 0, and (x, x) = if and only if x = 0. 

2. (x + y,z) = (x,z) + (y,z) 

3. (cx,y) = c(x, y) 

4. (x.y) = (y,x) 

( 1 /2 

Every inner product (x, y) gives rise to a norm ||x|| by de ning ||x|| = (x, x) 1 . 
A Hilbert space is a complete inner product space. A widely studied Hilbert 
space is L 2 [a, b] with the inner product (/, g) = f(t)g(t) dt. 

Two functions / and g in Li\a, b] are orthogonal if J" 6 /<? = 0. A set of L 2 

functions is orthogonal if 4>m4>n = form ^ n . The set is orthonormal 
if, in addition, each member has norm 1. That is, ||^„|| 2 = 1. For example, the 
functions {sin nx} are mutually orthogonal on (— tt, it). The functions { Slr ^ x } form 
an orthonormal set on (— tt, tt). 

Let {(f> n } be an orthonormal set in L 2 and / be in L 2 - The numbers c„ = 
Ja f4>n dx are the generalized Fourier coefficients of / with respect to {(/>„}, and the 
series 2^^Li c n<]>n{x) is called the generalized Fourier series of / with respect to 
{<«• 

For a function / in L 2 , the mean square error of approximating / by the sum 

T,n=i a n4>n is /„ l/W - En=i a n ^n(a;)| 2 dx. An orthonormal set is 
complete if the only measurable function / that is orthogonal to every <j> „ is zero. 
That is, / = a.e. (In the context of elementary measure theory, two measurable 
functions / and g are equivalent if they are equal except on a set of measure zero. 
They are said to be equal almost everywhere. This is denoted by / = g a.e.) 

Bessel's inequality: For a function / in L 2 having generalized Fourier coef - 

cients{c n },E^i|4|</ 1 ! , |/W| 2 ^- 
Theorems: 

Riesz— Fischer theorem Let {<f> n } be an orthonormal set in _L 2 
and let {c„} be constants such that Yl^Li \ c n \ converges. Then a unique 
function / in L 2 exists such that the c n are the Fourier coef cien ts of / 
with respect to {(f> n } and ^^Li c n<]>n converges in the mean (or order 
2) to/. 
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Theorem The generalized Fourier series of / in Li converges in 
the mean (of order 2) to /. 

\f(x)\ 2 dx = ^ | c n| • 
n=l 

Theorem The mean square error of approximating / by the se- 
ries Yl^Li a n<f>n is minimum when all coef cien ts a n are the Fourier 
coef c ients of / with respect to {(f> n }- 

EXAMPLE Suppose that the series 2f + £^° =1 (|a n | 2 + \b n \ 2 ) converges. Then the 
trigonometric series 4f + J2^=i ( a « cos nx + b n sin nx) is the Fourier series of some 
function in L 2 . 



1.7.10 ASYMPTOTIC RELATIONSHIPS 

Asymptotic relationships are indicated by the symbols O, fl, 8, o, and ~. 

1. The symbol O (pronounced "big-oh"): f(x) G 0(g(x)) as x — > x o if a pos- 
itive constant C exists such that |/(x)| < C \g(x)\ for all x suf ciently close 
to xo. Note that 0(g(x)) is a class of functions. Sometimes the statement 
f{x) G 0(g(x)) is written (imprecisely) as / = 0(g). 

2. The symbol fl : f(x) G fl(g(x)) as x — > x$ if a positive constant C exists 
such that \g(x)\ < C \ f(x) \ for all x suf ciently close to x$. 

3. The symbol : f(x) € Q(g(x)) as x — > a;o if positive constants ci and C2 
exist such that c\g(x) < f(x) < cig(x) for all x suf ciently close to x$. This 
is equivalent to: f(x) = 0(g(x)) and g(x) = 0(f(x)). The symbol w is 
often used for 6 (i.e., /(a;) ?s g (a;)). 

4. The symbol o (pronounced "little-oh"): f(x) G o(<?(a;)) as a; — > x$ if, given 
any > 0, we have |/(x)| < n\g(x) \ for all x suf ciently close to xo- 

5. The symbol ~ (pronounced "asymptotic to"): f(x) ~ (g(x)) as a; — > x o if 
/(x) = </(#) [1 + o(l)] as x — > a;o- 

6. Two functions, /(a;) and (jf(a;), are asymptotically equivalent as a; — > x$ if 
f(x)/g(x) ~ 1 as a; -> a; . 

7. A sequence of functions, {<7i;(a;)}, forms an asymptotic series at xo if 
fl*+i(aO = o(g k (x)) as a; -> a; . 

8. Given a function /(a;) and an asymptotic series {^(a;)} at x , the formal 
series J2^L ak9k(x), where the {au} are given constants, is an asymptotic 
expansion of f(x) if f(x) — ^22=o a k(Jk(x) = o(g n (x)) as x — > a;o for every n; 
this is expressed as /(a;) ~ cikdk(x)- Partial sums of this formal series 
are called asymptotic approximations to f(x). This formal series need not 
converge. 
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Think of being an upper bound on a function, Q being a lower bound, and 
being both an upper and lower bound. For example: sin x € O (x) as x — > 0, log n € 
o(n) as n — > oo, and n 9 € f2(n 9 + n 2 ) as n — > oo. 

The statements: n 2 = o(n 5 ), n 5 = o(2 n ), 2™ = o(n!), and n! = o(n") as 
n — > oo can be illustrated as follows. If a computer can perform 10 9 operations 
per second, and a procedure takes /(n) operations, then the following table indicates 
approximately how long it will take a computer to perform the procedure, for various 
f(n) functions and values of n. 



complexity 


n = 10 


n = 20 




n = 50 




n = 100 


n = 300 


f(n) = n 2 


10" 7 sec 


10" 7 sec 




10 -6 sec 




10 -6 sec 


10 -4 sec 


f(n) = n 5 


10" 4 sec 


10" 3 sec 




0.3 sec 




10 sec 


41 minutes 


f(n) = 2" 


10 -6 sec 


10" 3 sec 




2 weeks 


10 11 


centuries 


10 72 centuries 


f(n)=n\ 


10 -3 sec 


77 years 


10 46 


centuries 


1Q 139 


centuries 


10 696 centuries 


f(n) = n n 


10 sec 


10 7 centuries 


10 66 


centuries 


10 181 


centuries 


10 724 centuries 



1.8 GENERALIZED FUNCTIONS 



1.8.1 DELTA FUNCTION 

{0 x ^ 
, and is nor- 
oo x = 

malized so that S(x) dx = 1. Properties include (assuming that f(x) is contin- 
uous): 

!■ I-oo f(x)S(x -a)dx = /(a). 

2 f°° fix) 4 ™ 6 ^ dx = ( \) m dm f^ 

J — oo ^ V / dx m ^ ' dx m 

3. xS(x), as a distribution, equals zero. 

4. S(ax) = j^S(x) when a ^ 0. 

5. 6(x 2 - a 2 ) = j^[S(x + a) + S(x - a)]. 

6. S(x) = 2T + x Unli cos ^jt (Fourier series). 

7. S(x -0 = T T,n=i sin ^ sin ^ for < £ < L (Fourier sine series). 

8. S(x) = e lkx dk (Fourier transform). 
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9. 8(p- p') = p/ °° kJ m (kp)J m (kp')dk. 

Sequences of functions {(f> n } that approximate the delta function as n — > oo are 
known as delta sequences. 

EXAMPLES 



2. ^(z) = -$-e~ n ** 
3- <M*) = ^^ 



4. <?!> n (:r) 



\x\ > 1/n 
n/2 \x\ < 1/n 



The delta function S(x — x') = 6(x\ — x[)6(x2 — x' 2 )8{xz — x' 3 ) in terms of the 
coordinates (£1,^2, £3), related to {x\ , x 2 , x%), via the Jacobian J(xi,£j), is written 



S(x - x') 



1 



For example, in spherical polar coordinates 

1 



(1-8.1) 



5(x - x') = —8(r - r')5(<f> - <f>')5(cos0 - cos0'). 



(1.8.2) 



The solutions to differential equations involving delta functions are called Green's 
functions (see pages 463 and 471). 



1 .8.2 OTHER GENERALIZED FUNCTIONS 

The Heaviside function, or step function, is de ned as 



H(x) 



S(t) dt : 



x < 

1 x > 0. 



(1.8.3) 



Sometimes H(0) is stated to be 1/2. This function has the representations: 

1. i^) = I + f E ~ odd Isin^ 

2. H(x) = ^-JZ^dk 

The related signum function gives the sign of its argument: 

' -\ ifz<0 



sgn(a;) = 2H(x) - 1 



1 ifx>0. 



(1.8.4) 
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10.1 UNITS 



10.1.1 SI SYSTEM OF MEASUREMENT 

SI, the abbreviation of the French words "Systeme Internationale d'Unites", is the 
accepted abbreviation for the International Metric System. 



1. There are seven base units 



Quantity measured 


Unit 


Symbol 


Length 


meter 


m 


Mass 


kilogram 


kg 


Time 


second 


s 


Amount of substance 


mole 


mol 


Electric current 


ampere 


A 


Luminous intensity 


candela 


cd 


Thermodynamic temperature 


kelvin 


K 



2. There are 22 derived units with special names and symbols 



Quantity 


SI Name 


Symbol 


Combination of 
other SI units 
(or base units) 


Absorbed dose 


gray 


Gy 


J/kg 


Activity (radiation source) 


becquerel 


Bq 


1/s 


Capacitance 


farad 


F 


C/V 


Catalytic activity 


katal 


kat 


s _1 mol 


Celsius temperature 


degree Celsius 


°C 


K 


Conductance 


siemen 


s 


A/V 


Dose equivalent 


sievert 


Sv 


J/kg 


Electric charge 


coulomb 


c 


A s 


Electric potential 


volt 


V 


W/A 


Electric resistance 


ohm 


n 


V/A 


Energy 


joule 


j 


N m 


Force 


newton 


N 


kg m/s 2 


Frequency 


hertz 


Hz 


1/s 


Illuminance 


lux 


lx 


lm/m 2 


Inductance 


henry 


H 


Wb/A 


Luminous flux 


lumen 


lm 


cd sr 


Magnetic flux density 


tesla 


T 


Wb/m 2 


Magnetic flux 


weber 


Wb 


V s 


Plane angle 


radian 


rad 


m • m _1 








(unities s) 


Power 


watt 


W 


J/s 


Pressure or stress 


pascal 


Pa 


N/m 2 


Solid angle 


steradian 


sr 


m 2 • m -2 








(unitless) 
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3. The following units are accepted for use with SI units. 



Name 


Symbol 


Value in SI units 


(angle) degree 


O 


1° = (tt/180) rad 


(angle) minute 


/ 


1' = (1/60)° = (7r/10800) rad 


(angle) second 




1" = (1/60)' = (tt/648000) rad 


(time) day 


d 


1 d = 24 h = 86400 s 


(time) hour 


h 


1 h = 60 min = 3600 s 


(time) minute 


min 


1 min = 60 s 


astronomical unit 


au 


1 au ps 1.49598 x 10 11 m 


bel 


B 


1 B = (1/2) In 10 Np 






(Note that 1 dB = 0. 1 B) 


electronvolt 


eV 


1 eV ps 1.6021764 x 10" 19 C 


liter 


L 


1 L = 1 dm 3 = 10~ 3 m 3 


metric ton 


t 


1 1 = 10 3 kg 


neper 


Np 


1 Np = 1 (unitless) 


unified atomic mass unit 


u 


Iups 1.66054 x 10" 27 kg 



4. The following units are currently accepted for use with SI units (subject to 
further review). 



Name 


Symbol 


Value in SI units 


angstrom 


A 


lA=0.1nm= 10- 10 m 


are 


a 


1 a = 1 dam 2 = 10 2 m 2 


barn 


b 


1 b = 100 fm 2 = 10" 28 m 2 


bar 


bar 


1 bar = 0. lMPa= 100 kPa = 1000 hPa = 10 5 Pa 


curie 


Ci 


lCi = 3.7x 10 10 Bq 


hectare 


ha 


1 ha = 1 hm 2 = 10 4 m 2 


knot 




1 nautical mile per hour = (1852/3600) m/s 


nautical mile 




1 nautical mile = 1852 m 


rad 


rad 


1 rad = 1 cGy = 10" 2 Gy 


rem 


rem 


1 rem = 1 cSv = 10" 2 Sv 


roentgen 


R 


1 R = 2.58 x 10" 4 C/kg 



10.1.2 UNITED STATES CUSTOMARY SYSTEM OF WEIGHTS 
AND MEASURES 



Linear measure 




1 mile 


= 5280 feet or 320 rods 


lrod 


= 16.5 feet or 5.5 yards 


1 yard 


= 3 feet 


1 foot 


= 12 inches 


Linear measure: nautical 




1 fathom 


= 6 feet 


1° of latitude 


ps 69 miles 


1° of longitude at 40° latitude 


f» 46 nautical miles ps 53 miles 


1 nautical mile 


ps 6076. 1 feet ps 1 . 1508 statute miles 
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Square measure 










1 square mile 


_ 


640 acres 




1 acre 


_ 


43,560 square feet 


Volume measure 










1 cubic yard 


_ 


27 cubic feet 




1 cubic foot 


_ 


1728 cubic inches 


Dry measure 










1 bushel 


_ 


4 pecks 




1 peck 


_ 


8 quarts 




1 quart 


_ 


2 pints 


Liquid measure 










1 cubic foot 


_ 


7.4805 gallons 




1 gallon 


_ 


4 quarts 




1 quart 


_ 


2 pints 




1 pint 


_ 


4 gills 


Liquid measure: Apothecaries' 








1 pint 


_ 


16 fluid ounces 




1 fluid ounce 





8 drams 




1 fluid dram 


_ 


60 minims 


Weight: Avoirdupois 










1 ton 


_ 


2000 pounds 




1 pound 


_ 


16 ounces or 7000 grains 




1 ounce 


_ 


16 drams or 437.5 grains 


Weight: Troy 










1 pound 


_ 


12 ounces 




1 ounce 





20 pennyweights 


1 


pennyweight 


_ 


24 grains 


Weight: Apothecaries 










1 pound 




12 ounces 




1 ounce 




8 drams 




1 dram 




3 scruples 




1 scruple 




20 grains 



1 0.1 .3 PHYSICAL CONSTANTS 

c (speed of light) = 299,792,45 8 m/s (exact value) 

e (charge of electron) ?s 1.6021764 x 10" 19 C 

G (gravitational constant) ?s (6.673 ± 0.003) x 10" 8 cm 3 /g s 2 

h (Plank constant over 2tt) ps 1.0545716 x 10" 34 J s 

k (Boltzmann constant) ?s 1.38065 x 10" 23 J/K 

1 knot = 1 nautical mile/hour ?s 1.6878 ft/s ?s 1.1508 statute miles/hr 

Acceleration, sea level, latitude 45° « 9.806194 m/s 2 w 32.1726 ft/s 2 

Avogadro's constant ?s 6.022142 mol -1 

Density of mercury, at 0°C w 13.5951 g/mL 
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Density of water (maximum), at 3.98°C w 0.99997496 g/mL 

Density of water, at 0°C w 0.9998426 g/mL 

Density of dry air, at 0°C, 760 mm of Hg r; 1.2927 g/L 

Earth: equatorial radius r; 6378.388 km rj 3963.34 statute miles 

Earth: polar radius rj 6356.912 km rj 3949.99 statute miles 

Earth: mean density r; 5.522 g/cm 3 r; 344.7 lb/ft 3 

Heat of fusion of water, at 0°C rj 333.6 J/g 

Heat of vaporization of water, at 100°C as 2256.8 J/g 

Mass of hydrogen atom rj 1.67353 x 10 ~ 24 g 

Velocity of sound, dry air, at 0°C Ri 331.36 m/s Ri 1087.1 ft/s 

Wavelength of orange -red line of krypton 86 Ri 6057.802 A 



10.1.4 DIMENSIONAL ANALYSIS/BUCKINGHAM PI 

The units of the parameters in a system constrain all the derivable quantities, regard- 
less of the equations describing the system. In particular, all derived quantities are 
functions of dimensionless combinations of parameters. The number of dimension- 
less parameters and their forms are given by the Buckingham pi theorem. 

In a system, the quantity u = f{W\ , Wi, ■ ■ ■ , W n ) is to be determined in terms 
of the n measurable variables and parameters {W{\ where / is an unknown func- 
tion. Let the quantities {u,T/F,} involve m fundamental dimensions labeled by 
Li,Z/2, • • • ,L m (such as length, mass, time, or charge). The dimensions of any 
of the {u, Wi} are given by a product of powers of the fundamental dimensions. For 
example, the dimensions of Wi are L\ n L b j 2 L b f ■ ■ ■ Z4™ where the {6^-} are real 
and called the dimensional exponents. A quantity is called dimensionless if all of 
its dimensional exponents are zero. Let b, = [6 a 6,2 • • • bim\ be the dimen- 
sion vector of Wi and let B = [bi b2 ... b„] be the m x n dimension matrix 
of the system. Let a = \a\ a-i ... a m ] T be the dimension vector of u and let 
y = [yi Vi ■ ■ ■ Un] T represent a solution of By = —a. Then, 

1. The number of dimensionless quantities isfc + l = n + l — rank(_B). 

2. The measurable quantity u can be expressed in terms of dimensionless param- 
eters as 

u = W^ yi Wp 2 ■■■W-V" g(ir u ir 2 ,...,ir k ) (10.1.1) 

where g is an unknown function of its parameters and the {7r,} are dimen- 
sionless quantities. Specifically, let xW = { X \i x^i ■ ■ ■ x n i Y be one of 
k = n — r(B) linearly independent solutions of the system Bx = and define 

7Tj =W? u W% 2i ---W^. 
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10.1.5 UNITS OF PHYSICAL QUANTITIES 



In the following, read "kilograms" for the mass M, "meters" for the length L, "sec- 
onds" for the time T, and "degrees" for the temperature 9. For example, acceleration 
is measured in units of L/T 2 , or meters per second squared. 



On nntitv 


Dimensions 


On anti tv 




Acceleration 


L/T 2 
l/T 2 


Mass 


M 


Angular acceleration 


Mass density 


M/L 3 


Angular frequency 


l/T 


Momentum 


ML/T 


Angular momentum 


ML 2 /T 


Period 


T 


Angular velocity 


l/T 


Power 


ML 2 /T 3 

M/LT 2 

ML 2 


Area 


T 9 

L 1 


Pressure 


Displacement 


L 


Moment of inertia 


Energy or work 


ML 2 /T 2 
ML 2 /T 2 
ML 2 /T 2 
ML 2 /T 2 
ML /T 2 


Time 


T 


Energy, kinetic 


Torque 


ML 2 /T 2 


Energy, potential 


Velocity 


L/T 


Energy, total 


Volume 


L 3 


Force 


Wavelength 


L 


Frequency 


l/T 


Work 


ML 2 /T 2 
ML 2 /T 2 6 
ML 2 /T 2 
ML 2 /T 2 


Gravitational field strength 


ML/T 2 
ML 2 /T 2 


Entropy 


Gravitational potential 


Internal energy 


Length 


L 


Heat 



10.1.6 CONVERSION: METRIC TO ENGLISH 



Multiply 


By 


To obtain 


centimeters 


0.3937008 


inches 


cubic meters 


1.307951 


cubic yards 


cubic meters 


35.31467 


cubic feet 


grams 


0.03527396 


ounces 


kilograms 


2.204623 


pounds 


kilometers 


0.6213712 


miles 


liters 


0.2641721 


gallons (US) 


meters 


1.093613 


yards 


meters 


3.280840 


feet 


milliliters 


0.03381402 


fluid ounces 


milliliters 


0.06102374 


cubic inches 


square centimeters 


0.1550003 


square inches 


square meters 


1.195990 


square yards 


square meters 


10.76391 


square feet 
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10.1.7 CONVERSION: ENGLISH TO METRIC 



Multiply 


By 


To obtain 


cubic feet 


0.02831685 


cubic meters 


cubic inches 


16.38706 


milliliters 


cubic yards 


0.7645549 


cubic meters 


feet 


0.3048000 


meters 


fluid ounces 


29.57353 


milliliters 


gallons (US) 


3.785412 


liters 


inches 


2.540000 


centimeters 


miles 


1.609344 


kilometers 


mils 


25.4 


micrometers 


ounces 


28.34952 


grams 


pounds 


0.4535924 


kilograms 


square feet 


0.09290304 


square meters 


square inches 


6.451600 


square centimeters 


square yards 


0.8361274 


square meters 


yards 


0.9144000 


meters 



10.1.8 MISCELLANEOUS CONVERSIONS 



Multiply 


By 


To obtain 


feet of water at 4°C 


2.950 x 10" 2 


atmospheres 


inches of mercury at 4°C 


3.342 x 10" 2 


atmospheres 


pounds per square inch 


6.804 x 10" 2 


atmospheres 


foot-pounds 


1.285 x 10" 3 


BTU 


joules 


9.480 x 10" 4 


BTU 


cords 


128 


cubic feet 


radian 


57.29578 


degree (angle) 


foot-pounds 


1.356 x 10 7 


ergs 


atmospheres 


33.90 


feet of water at 4 °C 


miles 


5280 


feet 


horsepower 


3.3 x 10 4 


foot-pounds per minute 


horsepower-hours 


1.98 x 10 6 


foot-pounds 


kilowatt-hours 


2.655 x 10 6 


foot-pounds 


foot-pounds per second 


1.818 x 10- 3 


horsepower 


atmospheres 


2.036 


inches of mercury at 0°C 


BTU 


1.055060 x 10 3 


joules 


foot-pounds 


1.35582 


joules 


BTU per minute 


1.758 x 10" 2 


kilowatts 


foot-pounds per minute 


2.26 x 10" 5 


kilowatts 


horsepower 


0.7457 


kilowatts 


miles per hour 


0.8689762 


knots 
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Multiply 


By 


To obtain 


feet 


1.893939 x 10" 4 


miles 


miles 


0.8689762 


nautical miles 


degrees 


1.745329 x 1CT 2 


radians 


acres 


43560 


square feet 


BTU per minute 


17.5796 


watts 



10.1.9 TEMPERATURE CONVERSION 

If t F is the temperature in degrees Fahrenheit and tc is the temperature in degrees 
Celsius, then 

5 9 
t c = -(t F - 32) and t F = -t c + 32. (10.1.2) 



-40°C 


0°C 


10°C 


20°C 


37°C 


100°C 


-40°F 


32°F 


50°F 


68°F 


98.6°F 


212°F 



If Tk is the temperature in kelvin and Tr is the temperature in degrees Rankine, 

then 

T R =t F +459.69 and T K = t c + 273.15 = ^T R . (10.1.3) 



1 0.2 INTERPRETATIONS OF POWERS OF 1 



10 -15 the radius of the hydrogen nucleus (a proton) in meters 

10 -11 the likelihood of being dealt 13 top honors in bridge 

10~ 10 the radius of a hydrogen atom in meters 

10~ 9 the number of seconds it takes light to travel one foot 

10~ 6 the likelihood of being dealt a royal flush in poker 

10° the density of water is 1 gram per milliliter 

10 1 the number of fingers that people have 

10 2 the number of stable elements in the periodic table 

10 5 the number of hairs on a human scalp 

10 6 the number of possible chess board positions after 4 moves 

10 7 the number of seconds in a year 

10 8 the speed of light in meters per second 

10 9 the number of heartbeats in a lifetime for most mammals 
10 10 the number of people on the earth 

10 15 the surface area of the earth in square meters 

10 16 the age of the universe in seconds 

10 18 the volume of water in the earth's oceans in cubic meters 

10 19 the number of possible positions of Rubik's cube 
10 21 the volume of the earth in cubic meters 
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10 24 the number of grains of sand in the Sahara desert 

10 28 the mass of the earth in grams 

10 33 the mass of the solar system in grams 

10 50 the number of atoms in the earth 

10 78 the volume of the universe in cubic meters 



(Note: these numbers have been rounded to the nearest power of ten.) 



1 0.3 CALENDAR COMPUTATIONS 



10.3.1 LEAP YEARS 

If a year is divisible by 4, then it will be a leap year, unless the year is divisible by 
100 (when it will not be a leap year), unless the year is divisible by 400 (when it will 
be a leap year). Hence the list of leap years includes 1896, 1904, 1908, 1992, 1996, 
2000, 2004, 2008 and the list of non-leap years includes 1900, 1998, 1999, 2001. 



10.3.2 DAY OF WEEK FOR ANY GIVEN DAY 

The following formula gives the day of the week for the Gregorian calendar (i.e., for 
any date after 1582): 



W =[k+ [2.6m - 0.2J -2C + Y + 



Y 




C 






+ 




) 


~4_ 


~4_ 





(mod 7) (10.3.1) 



where 



• W is the day of the week (0 = Sunday, . . . , 6 = Saturday). 

• k is the day of the month (1 to 31). 

• to is the month (1 = March, . . . , 10 = December, 11 = January, 12 = Febru- 
ary). (January and February are treated as months of the preceding year.) 

• C is century minus one (1997 has C = 19, 2005 has C = 20). 

• Y is the year (1997 has Y = 97 except Y = 96 for January and February). 

• [-J denotes the integer floor function. 

• The "mod" function returns a non-negative value. 

In any given year the following days fall on the same day of the week: 4/4, 6/6, 8/8, 
10/10, 12/12, 9/5, 5/9, 7/11,1 1/7, and the last day of February. 
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EXAMPLE Consider the date 16 March 1997 (for which k = 16, m = 1, C = 19, and 
Y = 97). From Equation (10.3. 1), we compute W = 16 + [2A\ - 38 + 97 + |_x J + 
LxJ ( mod 7) = 2 + 2- 3 + 6 + 3 + 4 (mod 7) = (mod 7). So this date was a 
Sunday. 

Because 7 does not divide 400, January 1 occurs more frequently on some days 
of the week than on others! In a cycle of 400 years, January 1 and March 1 occur on 
the following days with the following frequencies: 





Sun 


Mon 


Tue 


Wed 


Thu 


Fri 


Sat 


January 1 


58 


56 


58 


57 


57 


58 


56 


March 1 


58 


56 


58 


56 


58 


57 


57 



10.3.3 NUMBER OF EACH DAY OF THE YEAR 



Day 


Jan 


Feb 


Mar 


Apr 


May 


Jun 


Jul 


Aug 


Sep 


Oct 


Nov 


Dec 


1 


1 


32 


60 


91 


121 


152 


182 


213 


244 


274 


305 


335 


2 


2 


33 


61 


92 


122 


153 


183 


214 


245 


275 


306 


336 


3 


3 


34 


62 


93 


123 


154 


184 


215 


246 


276 


307 


337 


4 


4 


35 


63 


94 


124 


155 


185 


216 


247 


277 


308 


338 


5 


5 


36 


64 


95 


125 


156 


186 


217 


248 


278 


309 


339 


6 


6 


37 


65 


96 


126 


157 


187 


218 


249 


279 


310 


340 


7 


7 


38 


66 


97 


127 


158 


188 


219 


250 


280 


311 


341 


8 


8 


39 


67 


98 


128 


159 


189 


220 


251 


281 


312 


342 


9 


9 


40 


68 


99 


129 


160 


190 


221 


252 


282 


313 


343 


10 


10 


41 


69 


100 


130 


161 


191 


222 


253 


283 


314 


344 


11 


11 


42 


70 


101 


131 


162 


192 


223 


254 


284 


315 


345 


12 


12 


43 


71 


102 


132 


163 


193 


224 


255 


285 


316 


346 


13 


13 


44 


72 


103 


133 


164 


194 


225 


256 


286 


317 


347 


14 


14 


45 


73 


104 


134 


165 


195 


226 


257 


287 


318 


348 


15 


15 


46 


74 


105 


135 


166 


196 


227 


258 


288 


319 


349 


16 


16 


47 


75 


106 


136 


167 


197 


228 


259 


289 


320 


350 


17 


17 


48 


76 


107 


137 


168 


198 


229 


260 


290 


321 


351 


18 


18 


49 


77 


108 


138 


169 


199 


230 


261 


291 


322 


352 


19 


19 


50 


78 


109 


139 


170 


200 


231 


262 


292 


323 


353 


20 


20 


51 


79 


110 


140 


171 


201 


232 


263 


293 


324 


354 


21 


21 


52 


80 


111 


141 


172 


202 


233 


264 


294 


325 


355 


22 


22 


53 


81 


112 


142 


173 


203 


234 


265 


295 


326 


356 


23 


23 


54 


82 


113 


143 


174 


204 


235 


266 


296 


327 


357 


24 


24 


55 


83 


114 


144 


175 


205 


236 


267 


297 


328 


358 


25 


25 


56 


84 


115 


145 


176 


206 


237 


268 


298 


329 


359 


26 


26 


57 


85 


116 


146 


177 


207 


238 


269 


299 


330 


360 


27 


27 


58 


86 


117 


147 


178 


208 


239 


270 


300 


331 


361 


28 


28 


59 


87 


118 


148 


179 


209 


240 


271 


301 


332 


362 


29 


29 


* 


88 


119 


149 


180 


210 


241 


272 


302 


333 


363 


30 


30 




89 


120 


150 


181 


211 


242 


273 


303 


334 


364 


31 


31 




90 




151 




212 


243 




304 




365 



*In leap years, after February 28, add 1 to the tabulated number. 
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10.4 AMS CLASSIFICATION SCHEME 



00 


General 


45 


Tntppral pnnations 

llllV^^ltll V^U UlIL1\_/11l3 


01 


History and biography 


46 


Functional analysis 


03 


\Tatrtpmatiral lncrir and 

1 V 1 tl 1 1 IV, 1 1 1 tl I 1 ^ tl 1 LKJlLl\s CLllV-J. 


47 


Onpratnr thpnrv 




foundations 


49 


Calculus of variations and optimal 


04 


This sprtinn has bppn HplptpH 




control; optimization 


05 


Combinatorics 


51 


Geometry 


06 


Order, lattices, ordered algebraic 


52 


Convex and discrete geometry 




structures 


53 


Differential geometry 


08 


Gpnpral alpphraip svstpms 

VJ ^.11^.1 til tllg^. UL till- l> \ l3 LWIIIl) 


54 


General topology 


1 1 


Nnmhpr thpnrv 


55 


Algebraic topology 


12 


Field theory and polynomials 


57 


Manifolds and cell complexes 


13 


Commutative rings and algebras 


58 


Global analysis, analysis on 


14 


Algebraic geometry 




manifolds 


15 


Linear and multilinear algebra; 


60 


Probability theory and stochastic 




matrix theory 




processes 


16 


A ccrwi utivp rincQ nnH filtypriras 


62 




17 




65 


Niimpripal anal vqi c 


18 


Category theory; homological 


68 


Computer science 




algebra 


70 


Mechanics of particles and 


19 


Tv^-thpnrv 




systems 


20 


Group theory and generalizations 


73 


This section has been deleted 


22 


Topological groups, Lie groups 


74 


Mechanics of deformable solids 


26 


Real functions 


76 


Fluid mechanics 


28 


Measure and integration 


78 


Optics, electromagnetic theory 


30 


Functions of a complex variable 


80 


Classical thermodynamics, heat 


31 


Potential theory 




transfer 


32 


Several complex variables and 


81 


Quantum theory 




analytic spaces 


82 


Statistical mechanics, structure of 


33 


Special functions 




matter 


34 


Ordinary differential equations 


83 


Rplativitv and trravitatinnal rhpnrv 


35 


Partial differential equations 


85 


Astronomy and astrophysics 


37 


Dynamical systems and ergodic 


86 


Geophysics 




theory 


90 


Operations research, mathematical 


39 


Difference and functional 




programming 




equations 


91 


Game theory, economics, social 


40 


Sequences, series, summability 




and behavioral sciences 


41 


Approximations and expansions 


92 


Biology and other natural sciences 


42 


Fourier analysis 


93 


Systems theory; control 


43 


Abstract harmonic analysis 


94 


Information and communication, 


44 


Integral transforms, operational 




circuits 




calculus 


97 


Mathematics education 



See www. ams . org/msc/ for details. 
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10.5 FIELDS MEDALS 



The Fields medal is the most prestigious award that can be bestowed upon a mathe- 
matician. It is awarded to someone no more than 40 years of age. 



(1) 


1936 


Ahlfors, Lars 


29 


Harvard University 


(2) 


1936 


Douglas, Jesse 


39 


MIT 


(3) 


1950 


Schwartz, Laurent 


35 


Universite de Nancy 


(4) 


1950 


Selberg, Atle 


33 


Princeton/Inst. for Advanced Study 


(5) 


1954 


Kodaira, Kunihiko 


39 


Princeton University 


(6) 


1954 


Serre, Jean-Pierre 


27 


College de France 


(7) 


1958 


Roth, Klaus 


32 


University of London 


(8) 


1958 


Thorn, Rene 


35 


University of Strasbourg 


(9) 


1962 


Hormander, Lars 


31 


University of Stockholm 


(10) 


1962 


Milnor, John 


31 


Princeton University 


(11) 


1966 


Atiyah, Michael 


37 


Oxford University 


(12) 


1966 


Cohen, Paul 


32 


Stanford University 


(13) 


1966 


Grothendieck, Alexander 


38 


University of Paris 


(14) 


1966 


Smale, Stephen 


36 


University of California at Berkeley 


(15) 


1970 


Baker, Alan 


31 


Cambridge University 


(16) 


1970 


Hironaka, Heisuke 


39 


Harvard University 


(17) 


1970 


Novikov, Serge 


32 


Moscow University 


(18) 


1970 


Thompson, John 


37 


University of Chicago 


(19) 


1974 


Bombieri, Enrico 


33 


University of Pisa 


(20) 


1974 


Mumford, David 


37 


Harvard University 


(21) 


1978 


Deligne, Pierre 


33 


IHES 


(22) 


1978 


Fefferman, Charles 


29 


Princeton University 


(23) 


1978 


Margulis, Gregori 


32 


InstPrblmlnfTrans 


(24) 


1978 


Quillen, Daniel 


38 


MIT 


(25) 


1982 


Connes, Alain 


35 


IHES 


(26) 


1982 


Thurston, William 


35 


Princeton University 


(27) 


1982 


Yau, Shing-Tung 


33 


IAS 


(28) 


1986 


Donaldson, Simon 


27 


Oxford University 


(29) 


1986 


Faltings, Gerd 


32 


Princeton University 


(30) 


1986 


Freedman, Michael 


35 


University of California at San Diego 


(31) 


1990 


Drinfeld, Vladimir 


36 


Phys. Inst. Kharkov 


(32) 


1990 


Jones, Vaughan 


38 


University of California at Berkeley 


(33) 


1990 


Mori, Shigefumi 


39 


University of Kyoto 


(34) 


1990 


Witten, Edward 


38 


Princeton/Inst. for Advanced Study 


(35) 


1994 


Bourgain, Jean 


40 


Princeton/Inst. for Advanced Study 


(36) 


1994 


Lions, Pierre-Louis 


38 


Universite de Paris-Dauphine 


(37) 


1994 


Yoccoz, Jean-Chrisophe 


36 


Universite de Paris-Sud 


(38) 


1994 


Zelmanov, Efim 


39 


University of Wisconsin 


(39) 


1998 


Borcherds, Richard E. 


38 


Cambridge University 


(40) 


1998 


Gowers, William T. 


34 


Cambridge University 


(41) 


1998 


Kontsevich, Maxim 


34 


Institut des Hautes Etudes Scientifiques 
and Rutgers University 


(42) 


1998 


McMullen, Curtis T. 


40 


Harvard University 
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10.6 GREEK ALPHABET 



For each Greek letter, we illustrate the form of the capital letter and the form of the 
lower case letter. In some cases, there is a popular variation of the lower case letter. 



Greek 


Greek 


English 




Greek 




Greek 


English 


letter 


name 


equivalent 




letter 




name 


equivalent 


A a 


Alpha 


a 


N 


V 




Nu 


n 


B p 


Beta 


b 




t 




Xi 


X 


r 7 


Gamma 


g 










Omicron 





A 6 


Delta 


d 


n 


7T 


w 


Pi 


P 


E e e 


Epsilon 


e 


p 


P 


Q 


Rho 


r 


z ( 


Zeta 


z 


>: 


a 


? 


Sigma 


s 


H 7] 


Eta 


e 


T 


T 




Tau 


t 


e e 


Theta 


th 


T 


V 




Upsilon 


u 


I L 


Iota 


i 


$ 


4> 




Phi 


ph 


K K 


Kappa 


k 


X 


X 




Chi 


ch 


A A 


Lambda 


1 


* 


1> 




Psi 


ps 


M fj, 


Mu 


m 





0J 




Omega 






10.7 COMPUTER LANGUAGES 



The following is a sampling of computer languages used by scientists and engineers: 



1. Numerical languages 

• Matlab and Octave 

• C and C++ 

• Fortran 

• Lisp 

2. Statistical languages 

• SPSS 

• Minitab 



3. Optimization languages 

• GAMS (AMPL) 

• MINOS 

• MINTO 

4. Symbolic languages 

• Derive 

• Maple 

• Mathematica 

• Reduce 



10.7.1 SOFTWARE CONTACT INFORMATION 



1. 


Derive 


http 


//www 


derive . com 


2. 


Fortran 


http 


//www 


f ortran. com 


3. 


Maple 


http 


//www 


maplesof t . com 


4. 


MathCad 


http 


//www 


mathsof t . com 


5. 


Matlab 


http 


//www 


mathworks . com 


6. 


Mathematica 


http 


//www 


wolfram. com 
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10.8 PROFESSIONAL MATHEMATICAL 
ORGANIZATIONS 

1. American Mathematical Society (AMS) 

201 Charles Street, Providence, RI 02904 
Telephone: 800/32 1 -4AMS 
Electronic address: www . ams . org 

2. American Mathematical Association of Two-Year Colleges 

Southwest Tennessee Community College 
5983 Macon Cove, Memphis, TN 38134 
Telephone: 901/333-4643 
Electronic address: www . amatyc . org 

3. American Statistical Association 

1429 Duke Street, Alexandria, VA 22314 

Telephone: 703/684-1221 

Electronic address: www . amstat . org 

4. Association for Symbolic Logic 

Box 742, Vassar College, 124 Raymond Avenue 

Poughkeepsie, New York 12604 

Telephone: 845/437-7080 

Electronic address: www.aslonline.org 

5. Association for Women in Mathematics 

41 14 Computer & Space Sciences Building, University of Maryland, 

College Park, MD 20742 

Telephone: 301/405-7892 

Electronic address: www.awm-math.org 

6. Canadian Applied Mathematics Society 

Department of Mathematics and Statistics, Simon Fraser University, 
Burnaby, British Columbia, Canada V5A 1S6 
Telephone: 604/291-3337, 604/291-3332 
Electronic address: www . cairns . ca 

7. Canadian Applied and Industrial Mathematics Society 

577 King Edward, Suite 109, P. O. Box 450, Station A, 

Ottawa, Ontario, Canada KIN 6N5 

Telephone: 613/562-5702 

Electronic address: www . cms . math . ca 

8. Casualty Actuarial Society 

1 100 North Glebe Road, Suite 600, Arlington, VA 22201 

Telephone: 703/276-3100 

Electronic address: www . casact . org 
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9. Conference Board of the Mathematical Sciences 

1529 Eighteenth Street, N.W., Washington, DC 20036 

Telephone: 202/293-1170 

Electronic address: www . cbmsweb . org 

10. The Consortium for Mathematics and Its Applications (COMAP) 

57 Bedford Street, Suite 210, Lexington, MA 02420 
Telephone: 800/77-COMAP 
Electronic address: www . comap . com 

1 1 . Council on Undergraduate Research 

Council on Undergraduate Research. 734 15th St. N.W., Suite 550, Washing- 
ton, DC 20005 
Telephone: 202/783-4810 
Electronic address: www . cur . org 

12. The Fibonacci Association 

Chase Building, Dalhousie University 
Halifax, Nova Scotia, Canada B3H 3J5 
Telephone: 902/494-2572 

Electronic address: www.mscs.dal.ca/Fibonacci/ 

13. Institute for Operations Research and the Management Sciences 
(INFORMS) 

940- A Elkridge Landing Road, Linthicum, MD 21090 
Telephone: 800/4IN-FORMS 
Electronic address: www . informs . org 

14. Institute of Mathematical Statistics 

P.O. Box 22718 
Beachwood, OH 44122 
Telephone: 216/295-2340 
Electronic address: www . imstat . org 

15. International Mathematics Union (IMU) 

Estrada Dona Castorina, 1 10, Jardim Botanico, 
Rio de Janeiro - RJ 22460 Brazil 
Telephone: 55-21-294 9032, 55-21-5111749 
Electronic address: www.mathunion.org 

16. Joint Policy Board for Mathematics 

1 Oxford Street #325, Cambridge, MA 02138 
Electronic address: www.jpbm.org 

17. Kappa Mu Epsilon (n/ie) 

Electronic address: www . est . cmich . edu/ org/kme_nat 

18. The Mathematical Association of America (MAA) 

1529 Eighteenth Street, N.W., Washington, DC 20036 
Telephone: 202/387-5200 
Electronic address: www.maa.org 
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19. Mathematical Programming Society 

3600 University City Science Center, Philadelphia, PA 19104 
Telephone: 215/382-9800, x323 

Electronic address: www.caam.rice.edu/~mathprog/ 

20. Mu Alpha Theta (ptaff) 

University of Oklahoma, 610 Elm Avenue, Room 423 

Norman, OK 73019 

Telephone: 405/325-4489 

Electronic address: www.mualphatheta.org 

21 . National Association of Mathematicians 

Department of Mathematics, Morehouse College 
Atlanta, GA 30314 

Electronic address: www.caam.rice.edu/~nated/orgs/nam/index.html 

22. The National Council of Teachers of Mathematics 

1906 Association Drive, Reston, VA 22091 
Telephone: 703/620-9840 
Electronic address: www.nctm.org 

23. ORSA (see INFORMS) 

24. Pi Mu Epsilon (7r/ie) 

Electronic address: www.pme-math.org 

25. Rocky Mountain Mathematics Consortium 

Arizona State University, Box 871904, Tempe, AZ 85287 

Telephone: 602/965-3788 

Electronic address: math.la.asu.edu/~rmmc 

26. Society of Industrial and Applied Mathematics (SIAM) 

3600 University City Science Center, Philadelphia, PA 19104 
Telephone: 215/382-9800 
Electronic address: www.siam.org 

27. The Society for Mathematical Biology 

Electronic address: www . smb . org 

28. Society of Actuaries 

475 North Martingale Road, Suite 800, Schaumburg, IL 60173 
Telephone: 847/706-3500 
Electronic address: www.soa.org 

29. Statistical Society of Canada 

1485 Laperrire St., Ottawa, Ontario K1Z 7S8 
Telephone: 613/725-2253 
Electronic address: www . ssc . ca 
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10.9 ELECTRONIC MATHEMATICAL RESOURCES 



1. General web sites related to mathematics 

(a) http : / / dir . yahoo . com/Science/mathemat ics/ 

A very large list of useful sites relating to mathematics. It is perhaps the best 
place to start researching an arbitrary mathematical question not covered else- 
where in this list. 

(b) http : / / web . math . f su . edu/Science/ math . html 

The mathematics WWW virtual library has a very comprehensive collection of 
links to other mathematics-related sites. 

(c) http://mathworld.wolfram.com 

A comprehensive on-line encyclopedia of mathematics with more than 10,000 
entries, 4,000 figures, and 100 animated graphics. 

(d) http://www.sosmath.com 

A collection of sites of mathemical interest on the web. 

(e) http : / / carbon . cudenver . edu/~hgreenbe/ glossary/ intro . html 
A mathematical programming glossary. 

(f) http://thesaurus.maths.org 
A mathematical thesaurus. 

(g) http: //www. cs .unb. ca/~alopez-o/math-f aq/math-f aq.html 
The FAQ (frequently asked questions) listing from the news group sci.math. 

2. Web sites that respond to user input 

(a) http://www-neos.mcs.anl.gov/ 

The NEOS server for optimization will run many different optimization packages 
on an input user problem. 

(b) http : //www . theory. esc .UVic . CA/~cos/ 

The Combinatorial Object Server creates combinatorial objects such as neck- 
laces, permutations, combinations, etc. 

(c) http : //www . research . att . com/~nj as/sequences/ 

The On-Line Encyclopedia of Integer Sequences allows the "next term" in a 
sequence to be determined. (See page 25.) 

(d) http: //www. cecm. sf u. ca/projects/ISC/ 

If a real number is input to the Inverse Symbolic Calculator it will determine 
where this number might have come from. 

3. Societies 

(a) http://www.ams.org 

The American Mathematical Society with the Combined Membership List of the 
AMS and the Math Reviews subject classifications. 

(b) http://www.maa.org/ 

The Mathematics Association of America. 
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(c) http://www.siam.org/ 

The Society for Industrial and Applied Mathematics. 

(d) http : / / www . ima . umn . edu 

Institute for Mathematics and its Applications at the University of Minnesota. 

(e) http : / / www . comap . com 

The Consortium for Mathematics and its Applications, with links appropriate for 
elementary, high school, and college undergraduates. They also sponsor contests 
in mathematics for college students and high school students. 

4. Software 

(a) http://gams.cam.nist.gov 

The Guide to Available Mathematical Software. 

(b) http://www.mathtools.net 

Mathematical tools (programs) in many different computing languages. 

(c) http : / / www . gnu . org/ software/ gsl/ 

The GNU scientific library is a freely available numerical library in C and C++. 

(d) http://www.netlib.org 

The master listing for Netlib, containing many standard programs, including lin- 
pack, eispack, hompack, SPARC packages, and ODEpack. 

(e) http : / / www . nag .co.uk 

The home page of the Numerical Algorithms Group. 

5. Journals, pre-prints, and essays 

(a) http://dlmf.nist.gov 

The "Digital Library of Mathematical Functions" from the National Institute of 
Standards and Technology. 

(b) http : / / arxiv . org/ archive/math 

A mathematics preprint server based at the Los Alamos National Laboratory. 

(c) http : / / www . mathcad . com/ library/ Constants/ index . htm 
A large collection of essays devoted to constants arising in mathematics. 

(d) http://ejde.math.swt.edu/ 

The Electronic Journal of Differential Equations. 

(e) http : / / ny j m . albany . edu : 8000/ny j m . html 

The New York Journal of Mathematics, the first electronic journal devoted to 
general mathematics. 

(f) http://www.wavelet.org 

The Wavelet Digest contains questions and answers about wavelets, and an- 
nouncements of papers, books, journals, software, and conferences. 

(g) http : //www . math . ohio-state . edu/ JAT 
The Journal of Approximation Theory. 

(h) http : / / www . combinatorics . org/ e j c-wce . html 

The Electronic Journal of Combinatorics and World Combinatorics Exchange. 
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(i) http : / / rattler . cameron . edu/ swj pam/ sw j pam . html 
The Southwest Journal of Pure and Applied Mathematics. 

6. Miscelleneous mathematical web sites 

(a) http : / / www . math . hmc . edu/ codee/main . html 

The Consortium of Ordinary Differential Equation Experiments. 

(b) http : //www.utm. edu/research/primes/largest .html 
Information about primes, including largest known primes of various types. 

(c) http : / / www . dartmouth . edu/ ~ chance/ index . html 
Material about teaching a "quantitative literacy course". 

(d) http : / / alephO . clarku . edu/~dj oyce/ j ulia/ explorer . html 
Useful for exploring the Mandelbrot and Julia sets. 

(e) ftp : / /megrez . math . u-bordeaux . f r/pub/numberf ields/ 

The Computational Number Theory group in Bordeaux has made available (by 
anonymous ftp at the above URL) extensive tables of number fields (almost 
550000 number fields). For the number fields belonging to tables of reasonable 
length, this site contains the signature, the Galois group of the Galois closure of 
the field, the discriminant of the number field, the class number, the structure 
of the class group as a product of cyclic groups, an ideal in the class for each 
class generating these cyclic groups, the regulator, the number of roots of unity 
in the field, a generator of the torsion part of the unit group, and a system of 
fundamental units. 

(f) http://www.eccpage.com 

The Error Correcting Codes (ECC) home page provides free software imple- 
menting several important error-correcting codes. 

(g) http : / / www . georgehart . com/virtual-polyhedra/vp . html 
An online "Encyclopedia of Polyehdra". 

(h) http : //www . earlham . edu/ "peter s/knot link . htm 
A collection of internet links related to knots. 

(i) http : / / www . mathsof t . com/ asolve/ 

A large collection of unsolved mathematical problems, and pointers to other col- 
lections. 

(j) http : //www . clarku . edu/~dj oyce/ wallpaper 

Pictures and descriptions of the 17 crystallographic groups; see page 307. 

(k) http : / /hcoonce . math . mankato . msus . edu/ 

The mathematics genealogy project; given the name of a PhD mathematician, 
this site will tell you who their thesis advisor was. 

EXAMPLE The editor-in-chief of this book has the ancestral sequence of advisors: 
D. I. Zwillinger — > B. S. White — > G. C. Papanicolaou — > J. B. Keller 
— > R. Courant — » D. Hilbert — )• C. L. F. Lindemann — » C. F. Klein 
— > R. O. S. Lipschitz and J. Plucker — > G. P. L. Dirichlet — > S. D. Poisson 
— )■ J. L. Lagrange — > L. Euler — > J. Bernoulli 
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10.10 BIOGRAPHIES OF MATHEMATICIANS 



In alphabetical order: 

1. Agnesi, Maria (page 814) 

2. Ah'mose (page 810) 

3. al-Haytham, Abu Ali (page 811) 

4. al-Khwarizmi, Muhammad (page 811) 

5. al-Tusi, Nasir al-Din (page 811) 

6. Archimedes (page 810) 

7. Banneker, Benjamin (page 814) 

8. Bernoulli, Johann (page 813) 

9. Bhaskara (page 811) 

10. Brahmagupta (page 811) 

11. Cardano, Gerolamo (page 812) 

12. Cauchy, Augustin-Louis (page 814) 

13. Cayley, Arthur (page 815) 

14. Dedekind, Richard (page 815) 

15. Descartes, Rene (page 812) 

16. Dickson, Leonard Eugene (page 816) 

17. Euclid (page 810) 

18. Euler, Leonhard (page 813) 

19. Fermat, Pierre de (page 813) 

20. Gauss, Carl Friedrich (page 814) 



21. Gerson, Levi ben (page 812) 

22. Hamilton, William Rowan (page 814) 

23. Hilbert, David (page 816) 

24. Hypatia (page 811) 

25. Jiushao, Qin (page 812) 

26. Kovalevskaya, Sofia (page 815) 

27. Lagrange, Joseph (page 814) 

28. Leibniz, Gottfried Wilhelm (page 813) 

29. Leonardo of Pisa (page 811) 

30. Napier, John (page 812) 

31. Newton, Isaac (page 813) 

32. Noether, Emmy (page 816) 

33. Pascal, Blaise (page 813) 

34. Poincare, Henri (page 816) 

35. Ptolemy (page 811) 

36. Riemann, Georg Bernhard (page 815) 

37. Stevin, Simon (page 812) 

38. Turing, Alan (page 816) 

39. Viete, Francois (page 812) 

40. Weierstrass, Karl (page 815) 



In chronological order: 

Ah'mose (c. 1650 B.C.E.) was the scribe responsible for copying the Rhind Papyrus, the 
most detailed original document still extant on ancient Egyptian mathematics. The 
papyrus contains some 87 problems with solutions dealing with what we consider first- 
degree equations, arithmetic progressions, areas and volumes of rectangular and circu- 
lar regions, proportions, and several other topics. It also contains a table of the results 
of the division of 2 by every odd number from 3 to 101. 

Euclid (c. 300 B.C.E.) is responsible for the most famous mathematics text of all time, the 
Elements. Not only does this work deal with the standard results of plane geometry, 
but it also contains three chapters on number theory, one long chapter on irrational 
quantities, and three chapters on solid geometry, culminating with the construction of 
the five regular solids. The axiom-definition-theorem-proof style of Euclid's work has 
become the standard for formal mathematical writing up to the present day. 

Archimedes (287-212 B.C.E.) not only wrote several works on mathematical topics more 
advanced than Euclid, but also was the first mathematician to derive quantitative results 
from the creation of mathematical models of physical problems on earth. In several of 
his books, he described the reasoning process by which he arrived at his results in 
addition to giving formal proofs. For example, he showed how to calculate the areas of 
a segment of a parabola and the region bounded by one turn of a spiral, and the volume 
of a paraboloid of revolution. 
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Ptolemy (c. 100-178 C.E.) is most famous for the Almagest, a work in thirteen books, which 
contains a complete mathematical description of the Greek model of the universe with 
parameters for the various motions of the sun, moon, and planets. The first book pro- 
vides the strictly mathematical material detailing the plane and spherical trigonometry, 
all based solely on the chord function, necessary for astronomical computations. 

Hypatia (c. 370-415), the first woman mathematician on record, lived in Alexandria. She 
was given a very thorough education in mathematics and philosophy by her father 
Theon and was responsible for detailed commentaries on several important Greek 
works, including Ptolemy's Almagest, Apollonius's Conies, and Diophantus's Arith- 
metiea. 

Brahmagupta (c. 598-670), from Rajasthan in India, is most famous for his Brahmas- 
phutasiddhanta ( Correct Astronomical System of Brahma), an astronomical work which 
contains many chapters on mathematics. Among the mathematical problems he con- 
sidered and gave solution algorithms for were systems of linear congruences, quadratic 
equations, and special cases of the Pell equation Dx 2 ± 1 = y 2 . He also gave the 
earliest detailed treatment of rules for operating with positive and negative numbers. 

Muhammad al-Khwarizmi (c. 780-850), originally from Khwarizm in what is now Uzbek- 
istan, was one of the first scholars called to the House of Wisdom in Baghdad by the 
caliph al-Ma'mun. He is best known for his algebra text, in which he gave a careful 
treatment of solution methods for quadratic equations. This Arabic text, after being 
translated into Latin in the twelfth century, provided Europeans with an introduction 
to algebra, a subject not considered by the ancient Greeks. Al-Khwarizmi's book on 
arithmetic provided Europe with one of its earliest looks at the Hindu- Arabic number 
system. 

Abu Ali ibn al-Haytham (965-1039), who spent much of his life in Egypt, is most famous 
for his work on optics, a work read and commented on for many centuries in Europe. 
In pure mathematics, he developed an inductive procedure for calculating formulae for 
the sums of integral powers of the first n integers, and used the formula for fourth 
powers to calculate the volume of the solid formed by revolving a parabola about a line 
perpendicular to its axis. 

Bhaskara (1114-1185), the most famous of medieval Indian mathematicians, gave a com- 
plete algorithmic solution to the Pell equation. In addition, he dealt with techniques of 
solving systems of linear equations with more unknowns than equations and was famil- 
iar with the basic combinatorial formulae, giving many examples, though no proofs, of 
their use. 

Leonardo of Pisa (1170-1240), often known today as Fibonacci, is most famous for his 
Liber Abbaci (Book of Calculation), which contains the earliest publication of the 
Fibonacci numbers in the problem of how many pairs of rabbits can be bred in one 
year from one pair. Many of the sources of the book are in the Islamic world, where 
Leonardo spent much of his early life. The work contains the rules for computing with 
the new Hindu-Arabic numerals, many practical problems in such topics as calculation 
of profits and currency conversions, and topics now standard in algebra texts such as 
motion problems, mixture problems, and quadratic equations. 

Nasir al-Din al-Tusi (1201-1274) was the head of a large group of astronomers at the ob- 
servatory in Maragha, in what is now Iran. He computed a new set of very accurate 
astronomical tables and developed some new ideas on planetary motion which may 
have influenced Copernicus in working out his heliocentric system. In pure mathe- 
matics, al-Tusi's attempted proof of the parallel postulate was modified by his son and 
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later published in Rome, where it influenced European work on non-Euclidean geom- 
etry. Al-Tusi also wrote the first systematic work on plane and spherical trigonometry, 
independent of astronomy, and gave the earliest proof of the theorem of sines. 

Qin Jiushao f 1202-1261 ), born in Sichuan, published a general procedure for solving sys- 
tems of linear congruences — the Chinese remainder theorem — in his Shushu jiuzhang 
(Mathematical Treatise in Nine Sections) in 1247, a procedure which makes essential 
use of the Euclidean algorithm. He also gave a complete description of a method for 
solving numerically polynomial equations of any degree. Qin's method was developed 
in China over a period of a thousand years or more and is very similar to what is now 
called Horner's method of solution, published by William Horner in 1819. 

Levi ben Gerson (1288-1344) was a French rabbi and also an astronomer, philosopher, 
biblical commentator, and mathematician. His most famous mathematical work is the 
Maasei Hoshev (The Art of the Calculator), which contains detailed proofs of the stan- 
dard combinatorial formulae, some of which use the principle of mathematical induc- 
tion. 

Gerolamo Cardano (1501-1576), a physician and gambler as well as a mathematician, 
wrote one of the earliest works containing systematic probability calculations, not all 
of which were correct. He is most famous, however, for his Ars Magna (The Great 
Art, 1545), an algebra text which contained the first publication of the rules for solving 
cubic equations algebraically. Some of the rules had been discovered earlier in the 
sixteenth century by Scipione del Ferro and Niccolo Tartaglia. 

Francois Viete (1540-1603), a lawyer and advisor to two kings of France, was one of the 
earliest cryptanalysts and successfully decoded intercepted messages for his patrons. 
Although a mathematician only by avocation, he made important contributions to the 
development of algebra. In particular, he introduced letters to stand for numerical con- 
stants, thus enabling him to break away from the style of verbal algorithms of his 
predecessors and treat general examples by formulae rather than by giving rules for 
specific problems. 

Simon Stevin ( 1548-1620) spent much of his life in the service of Maurice of Nassau, the 
Stadhouder of Holland, as a military engineer, advisor in finance and navigation, and 
quartermaster general of the Dutch army. In his book De Thiende (The Art of Tenths), 
Stevin introduced decimal fractions to Europe, although they had previously been used 
in the Islamic world. Stevin's notation is different from our own, but he had a clear 
understanding of the advantage of decimals and advocated their use in all forms of 
measurement. 

John Napier (1550-1617) was a Scottish laird who worked for years on the idea of pro- 
ducing a table which would enable one to multiply any desired numbers together by 
performing additions. These tables of logarithms first appeared in his 1614 book Miri- 
fici Logarithmorum Canonis Descriptio (Description of the Wonderful Canon of Loga- 
rithms). Napier's logarithms are different from, but related to, natural logarithms. His 
ideas were soon adapted by Henry Briggs, who eventually created the first table of 
common logarithms by 1628. 

Rene Descartes (1596-1650) published the Geometry in 1637 as a supplement to his philo- 
sophical work, the Discourse on the Method for Rightly Directing One's Reason and 
Searching for Truth in the Sciences. In it, he developed the principles of analytic geom- 
etry, showing how to derive algebraic equations which represented geometric curves. 
The Geometry also contained methods for solving polynomial equations, including the 
modern factor theorem and Descartes' rule of signs. 
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Pierre de Fermat ( 1601-1665) was a French lawyer who spent his spare time doing mathe- 
matics. Not only was he a coinventor of analytic geometry, although his methods were 
somewhat different from those of Descartes, but he also was instrumental in the early 
development of probability theory and made many contributions to the theory of num- 
bers. He is most remembered for the statement of his so-called "last theorem", that the 
equation x n + y n = z n has no non-trivial integral solution if n > 2, a theorem whose 
proof was finally completed by Andrew Wiles in 1994. 

Blaise Pascal (1623-1662) showed his mathematical precocity with his Essay on Conies 
of 1640 in which he stated his theorem that the opposite sides of a hexagon inscribed 
in a conic section always intersect in three collinear points. Pascal is better known, 
however, for his detailed study of what is now called Pascal's triangle of binomial 
coefficients, the basic facts of which had been known in the Islamic and Chinese worlds 
for centuries. He also introduced the differential triangle in his Treatise on the Sines of 
a Quadrant of a Circle, an idea adopted by Leibniz in his calculus. 

Isaac Newton (1642-1727), the central figure in the Scientific Revolution, is most famous 
for his Philosophiae Naturalis Principia Mathematica (Mathematical Principles of 
Natural Philosophy, 1687), in which he derived his system of the world based on his 
laws of motion and his law of universal gravitation. Over 20 years earlier, however, 
Newton had consolidated and generalized all the material on tangents and areas worked 
out by his predecessors into the magnificent problem solving tool of the calculus. He 
also developed the power series as a method of investigating various transcendental 
functions, stated the general binomial theorem, and, although never establishing his 
methods with the rigor of Greek geometry, did demonstrate an understanding of the 
concept of limit quite sufficient for him to apply the calculus to solve many important 
mathematical and physical problems. 

Gottfried Wilhelm Leibniz (1646-1716), born in Leipzig, developed his version of the 
calculus some ten years after Isaac Newton, but published it much earlier. Leibniz 
based his calculus on the inverse relationship of sums and differences, generalized to 
infinitesimal quantities called differentials. By clever manipulation of differentials, 
based in part on the geometrical model of the differential triangle, Leibniz was able to 
derive all of the basic rules of the differential and integral calculus and apply them to 
solve physical problems expressible in terms of differential equations. Leibniz's d and 
J notation for differentials and integrals turned out to be much more flexible and useful 
than Newton's dot notation and remains the notation of calculus to the present day. 

Johann Bernoulli (1667-1748), one of a number of prominent mathematicians of his Swiss 
family, was one of the earliest proponents of Leibniz's differential and integral calculus. 
Bernoulli helped to stimulate the development of the new techniques by proposing chal- 
lenge problems to mathematicians, the most important probably being that of describ- 
ing the brachistochrone, the curve representing the path of descent of a body between 
two given points in the shortest possible time. Many of the problems he posed required 
the solution of differential equations, and Bernoulli developed many techniques useful 
toward this end, including the calculus of the logarithmic and exponential functions. 

Leonhard Euler (1707-1783), a student of Johann Bernoulli in Basel who became one of 
the earliest members of the St. Petersburg Academy of Sciences founded by Peter the 
Great of Russia, was the most prolific mathematician of all time. His series of analysis 
texts, Introduction to Analysis of the Infinite, Methods of the Differential Calculus, and 
Methods of the Integral Calculus, established many of the notations and methods still in 
use today. Among his numerous contributions to every area of mathematics and physics 
are his development of the calculus of the trigonometric functions, the establishment 
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of the theory of surfaces in differential geometry, and the creation of the calculus of 
variations. 

Maria Agnesi (1718-1799), the eldest child of a professor of mathematics at the University 
of Bologna, in 1748 published the clearest text on calculus up to that point. Based 
on the work of Leibniz and his followers, the work explained concepts lucidly and 
provided numerous examples, including some that have become standard in calculus 
texts to this day. Curiously, her name is often attached to a small item in her book not 
even original with her, a curve whose equation was y = ± a ^^ x . This curve was 
called la versiera, derived from the Latin meaning "to turn"; unfortunately the word 
also was the abbreviation of the Italian word meaning "wife of the devil" and so was 
translated into English as "witch". The curve has ever since been known as the "witch 
of Agnesi". 

Benjamin Banneker (1731-1806), the first American black to achieve distinction in sci- 
ence, taught himself sufficient mathematics and astronomy to publish a series of well- 
regarded almanacs in the 1790s. He also assisted Andrew Ellicott in the survey of the 
boundaries of the District of Columbia. He was fond of solving mathematical puzzles 
and problems and recorded many of these in his notebooks. 

Joseph Lagrange (1736-1813), was born in Turin, becoming at age 19 a professor of math- 
ematics at the Royal Artillery School there. He is most famous for his Analytical 
Mechanics (1788), a work which extended the mechanics of Newton and Euler, and 
demonstrated how problems in mechanics can generally be reduced to solutions of or- 
dinary or partial differential equations. In 1797 he published his Theory of Analytic- 
Functions, which attempted to reduce the ideas of calculus to those of algebraic anal- 
ysis by assuming that every function could be represented as a power series. Although 
his central idea was incorrect, many of the proofs of basic theorems of calculus in this 
work were subsequently adapted by Cauchy into the forms still in use today. 

Carl Friedrich Gauss (1777-1855) published his important work on number theory, the 
Disquisitiones Arithmeticae, when he was only 24, a work containing not only an exten- 
sive discussion of the theory of congruences, culminating in the quadratic reciprocity 
theorem, but also a detailed treatment of cyclotomic equations in which he showed how 
to construct regular n-gons by Euclidean techniques whenever n is prime and n — 1 is 
a power of 2. Gauss also made fundamental contributions to the differential geometry 
of surfaces in his General Investigations of Curved Surfaces in 1827, as well as to com- 
plex analysis, astronomy, geodesy, and statistics during his long tenure as a professor at 
the University of Gottingen. Many ideas later published by others, including the basics 
of non-Euclidean geometry, were found in his notebooks after his death. 

Augustin-Louis Cauchy (1789-1857), the most prolific mathematician of the nineteenth 
century, wrote several textbooks in analysis for use at the Ecole Polytechnique, text- 
books which became the model for calculus texts for the next hundred years. In his 
texts, Cauchy based the calculus on the notion of limit, using, for the first time, a def- 
inition which could be applied arithmetically to give proofs of some of the important 
results. Among numerous other subjects to which he contributed important ideas were 
complex analysis, in which he gave the first proof of the Cauchy integral theorem, the 
theory of matrices, in which he demonstrated that every symmetric matrix can be diag- 
onalized by use of an orthogonal substitution, and the theory of permutations, in which 
he was the earliest to consider these from a functional point of view. 

William Rowan Hamilton (1805-1865) became the Astronomer Royal of Ireland in 1827 
because of his original work in optics accomplished during his undergraduate years 
at Trinity College, Dublin. In 1837, he showed how to introduce complex numbers 
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into algebra axiomatically by considering a + ib as a pair (a, b) of real numbers with 
appropriate computational rules. After many years of seeking an appropriate definition 
for multiplication rules for triples of numbers which could be applied to vector analysis 
in three-space, he discovered that it was in fact necessary to consider quadruplets of 
numbers. It was out of the natural definition of multiplication of these quaternions that 
the modern notions of dot product and cross product of vectors evolved. 

Karl Weierstrass (1815-1897) taught for many years at German gymnasia before producing 
a series of brilliant mathematical papers in the 1850s which resulted in his appointment 
to a professorship at the University of Berlin. It was in his lectures there that he insisted 
on defining every concept of analysis arithmetically, including such ideas as uniform 
convergence and uniform continuity, thus completing the transformation away from the 
use of terms such as "infinitely small". Since he himself never published many of these 
ideas, his primary influence was through the work of his numerous students. 

Arthur Cayley (1821-1895), although graduating from Trinity College, Cambridge, as Se- 
nior Wrangler, became a lawyer because there was no suitable mathematics position 
available in England. He produced nearly 300 mathematical papers during his 14 years 
as a lawyer, however, and finally secured a professorship at Cambridge in 1863. Among 
his numerous mathematical achievements are the earliest abstract definition of a group 
in 1854, out of which he was able to calculate all possible groups of order up to eight 
and the basic rules for operating with matrices, including a statement (without rigor- 
ous proof) of the Cayley-Hamilton theorem that every matrix satisfies its characteristic 
equation. 

Georg Bernhard Riemann (1826-1866), in his 1854 inaugural lecture at the University 
of Gottingen entitled "On the Hypotheses which Lie at the Foundation of Geometry", 
discussed the general notion of an n-dimensional manifold, developed the idea of a 
metric relation on such a manifold, and gave criteria which would determine whether 
a three-dimensional manifold is Euclidean, or "flat". This lecture had enormous influ- 
ence on the development of geometry, including non-Euclidean geometry, as well as 
on the development of a new concept of our physical space ultimately necessary for the 
theory of general relativity. Among his other achievements, Riemann's work on com- 
plex functions and their associated Riemann surfaces became one of the foundations of 
combinatorial topology. 

Richard Dedekind (1831-1916) solved the problem of the lack of unique factorization in 
rings of algebraic integers by introducing ideals and their arithmetic and demonstrat- 
ing that every ideal is either prime or can be expressed uniquely as a product of prime 
ideals. During his teaching at Zurich in the late 1850s, he realized that, although differ- 
ential calculus deals with continuous magnitudes, there was no satisfactory definition 
available of what it means for the set of real numbers to be continuous. He therefore 
worked out a definition of irrational numbers through his idea of what is now called 
a Dedekind cut in the set of rational numbers. Somewhat later Dedekind also consid- 
ered the basic ideas of set theory and gave a set theoretic characterization of the natural 
numbers. 

Sofia Kovalevskaya (1850-1891 ) was the first European woman since the Renaissance to 
earn a Ph.D. in mathematics (1874), a degree based on her many new results in the the- 
ory of partial differential equations. Because women were generally not permitted to 
study mathematics officially in European universities, Kovalevskaya had been forced 
to study privately with Weierstrass. Her mathematical talents eventually earned her a 
professorship at the University of Stockholm, an editorship of the journal Acta Math- 
ematica, and the Prix Bordin of the French Academy of Sciences for her work on the 
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revolution of a solid body about a fixed point. Unfortunately, her career was cut short 
by her untimely death from pneumonia at the age of 41. 

Henri Poincare (1854-1912), one of the last of the universal mathematicians, contributed 
to virtually every area of mathematics, including physics and theoretical astronomy. 
Among his many contributions was the introduction of the idea of homology into topol- 
ogy, the creation of a model of Lobachevskian geometry which helped to convince 
mathematicians that this non-Euclidean geometry was as valid as Euclid's, and a de- 
tailed study of the non-linear partial differential equations governing planetary motion 
aimed at answering questions about the stability of the solar system. Toward the end of 
his life, Poincare wrote several popular books emphasizing the importance of science 
and mathematics. 

David Hilbert (1862-1943) is probably most famous for his lecture at the International 
Congress of Mathematicians in Paris in 1900 in which he presented a list of 23 problems 
which he felt would be of central importance for 20th century mathematics. Most of 
the problems have now been solved, while significant progress has been achieved in the 
remainder. Hilbert himself made notable contributions to the study of algebraic forms, 
algebraic number theory, the foundations of geometry, integral equations, theoretical 
physics, and the foundations of mathematics. 

Leonard Eugene Dickson ( 1874-1 954) was the first recipient of a doctorate in mathematics 
at the University of Chicago, where he ultimately spent most of his mathematical ca- 
reer. Dickson helped to develop the abstract approach to algebra by developing sets of 
axioms for such constructs as groups, fields, and algebras. Among his important books 
was his monumental three volume History of the Theory of Numbers, which traced the 
evolution of every important concept in that field. 

Emmy Noether (1882-1935) received her doctorate from the University of Erlangen in 
1908, a few years later moving to Gottingen to assist Hilbert in the study of general 
relativity. During her 18 years there, she was extremely influential in stimulating a new 
style of thinking in algebra by always emphasizing its structural rather than computa- 
tional aspects. She is most famous for her work on what are now called Noetherian 
rings, but her inspiration of others is still evident in today's textbooks in abstract alge- 
bra. 

Alan Turing (1912-1954) developed the concept of a "Turing machine" in 1936 to answer 
the questions of what a computation is and whether a given computation can in fact be 
carried out. This notion today lies at the basis of the modern all-purpose computer, a 
machine which can be programmed to do any desired computation. During World War 
II, Turing led the successful effort in England to crack the German "Enigma" code, an 
effort central to the defeat of Nazi Germany. 
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Chapter 



Financial Analysis 



9.1 FINANCIAL FORMULAE 

9.1.1 Definition of financial terms 

9.1.2 Formulae connecting financial terms 

9.1.3 Examples 

9.2 FINANCIAL TABLES 

9.2.1 Compound interest: find final value 

9.2.2 Compound interest: find interest rate 

9.2.3 Compound interest: find annuity 



9.1 FINANCIAL FORMULAE 



9.1 .1 DEFINITION OF FINANCIAL TERMS 

A amount that P is worth, after n time periods, with i percent interest per period 

B total amount borrowed 

P principal to be invested (equivalently, present value) 

a future value multiplier after one time period 

i percent interest per time period (expressed as a decimal) 

m amount to be paid each time period 

n number of time periods 

Note that the units of A, B, P, and m must all be the same, for example, dollars. 
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9.1 .2 FORMULAE CONNECTING FINANCIAL TERMS 



1. Interest: Let the principal amount P be invested at an interest rate of i% per 
time period (expressed as a decimal), for n time periods. Let A be the amount 
that this is worth after n time periods. Then 

(a) Simple interest: 

A 1 (A 

A = P(l + ni) and P = and i = 1 

(1 +m) n 1 " 

(9.1.1) 

(b) Compound interest (see the tables beginning on page 783 for A and the 
tables beginning on page 785 for i): 

A /A\ 1 / n 

A = P(l + i) n and P = — and i = - - 1. 

V ' (l+i) n \PJ 

(9.1.2) 

When interest is compounded q times per time period for n time periods, 
it is equivalent to an interest rate of (i/q)% per time period for nq time 
periods. 

A = P [ 1 + * 

• \ — nq 

^4(1 + -) , (9.1.3) 



q 

P 



1 



Continuous compounding occurs when the interest is compounded in- 
finitely often in each time period (i.e., q — > oo). In this case: A = Pe m . 

2. Present value: If A is to be received after n time periods of i% interest per 
time period, then the present value P of such an investment is given by (from 
Equation (9.1.2)) P = A(l+i)~ n . 

3. Annuities: Suppose that the amount B (in dollars) is borrowed, at a rate of i% 
per time period, to be repaid at a rate of m (in dollars) per time period, for a 
total of n time periods. Then (see the tables beginning on page 787): 

(1 + i) n 

m = K (lW^T' (9 ' L4) 

B = ?(l-^). (9.1.5) 



i V (l+«) n 

Using a = (1 + i), these equations can be written more compactly as 

to = Bi and B = — [l . (9.1.6) 

a n — 1 i \ a n I 
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9.1.3 EXAMPLES 



1. Question: If $100 is invested at 5% per year, compounded annually for 10 
years, what is the resulting amount? 

• Analysis: Using Equation (9.1.2), we identify 

(a) Principal invested, P = 100 (the units are dollars) 

(b) Time period, 1 year 

(c) Interest rate per time period, i = 5% = 0.05 

(d) Number of time periods, n = 10 

• Answer: A = P(l + i) n or A = 100(1 + 0.05) 10 = $162.89. 
(Or, see tables starting on page 783.) 

2. Question: If $100 is invested at 5% per year and the interest is compounded 
quarterly (4 times a year) for 10 years, what is the final amount? 

• Analysis: Using Equation (9.1.3) we identify 

(a) Principal invested, P = 100 (the units are dollars) 

(b) Time period, 1 year 

(c) Interest rate per time period, i = 5% = 0.05 

(d) Number of time periods, n = 10 

(e) Number of compounding time periods, q = 4 

/ \ nq 

• Answer: A = P M + M or A = 100(1 + Mi) 4 ' 10 = 100(1.0125) 40 
= $164.36. 

• Alternate analysis: Using Equation (9.1.2), we identify 

(a) Principal invested, P = 100 (the units are dollars) 

(b) Time period, quarter of a year 

(c) Interest rate per time period, i = ^ = ^ = 0.0125 

(d) Number of time periods, n = 10 • 4 = 40 

• Alternate answer: A = P(l + i) n or A = 100(1.0 1 25) 40 = $164.36. 
(Or, see tables starting on page 783.) 

3. Question: If $100 is invested now, and we wish to have $200 at the end of 10 
years, what yearly compound interest rate must we receive? 

• Analysis: Using Equation (9.1.2), we identify 

(a) Principal invested, P = 100 (the units are dollars) 

(b) Final amount, A = 200 

(c) Time period, 1 year 

(d) Number of time periods, n = 10 
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• Answer: i = (£) 1/n - 1 or i = (f§g) 1/10 - 1 = 0.0718. (Or, see tables 
starting on page 785.) Hence, we must receive an annual interest rate of 
7.2%. 



4. Question: An investment returns $10,000 in 10 years time. If the interest rate 
will be 10% per year, what is the present value? (That is, how much money 
would have to be invested now to obtain this amount in ten years?) 

• Analysis: Using Equation (9.1.2), we identify 

(a) Final amount, A = 10, 000 (the units are dollars) 

(b) Time period, 10 years 

(c) Interest rate per time period, i = 10% = 0.1 

(d) Number of time periods, n = 10 

• Answer: P = A{1 + i)~ n = 10000(1. 1)" 10 = 3855.43; the present 
value of this investment is 3,855.43. (Or, the table on page 784 gives 
the value 2.5937; the present value of this investment is then yfjjfy = 
3,855.43). 

5. Question: A mortgage of $100,000 is obtained with which to buy a house. 
The mortgage will be repaid at an interest rate of 9% per year, compounded 
monthly, for 30 years. What is the monthly payment? 

• Analysis: Using Equation (9.1.6), we identify 

(a) Amount borrowed, B = 100, 000 (the units are dollars) 

(b) Time period, 1 month 

(c) Interest rate per time period, i = 0.09/12 = 0.0075 

(d) Number of time periods, n = 30 • 12 = 360 

• Answer: a = l + i = 1.0075 and m = Bi-^j = (100, 000)(.0075) 

x (/oo^sC" i = 804.62. (Or, see tables starting on page 787.) The 
monthly payment is $804.62. 

6. Question: Suppose that interest rates on 15-year mortgages are currently 6%, 
compounded monthly. By spending $800 per month, what is the largest mort- 
gage obtainable? 

• Analysis: Using Equation (9.1.6), we identify 

(a) Time period, 1 month 

(b) Payment amount, m = 800 (the units are dollars) 

(c) Interest rate per time period, i = 0.06/12 = 0.005 

(d) Number of time periods, n = 15 • 12 = 180 

. Answer: a = 1+i = 1.005 and B = f (l - = J&L (i _ 

= 94802.81. (Or, see tables starting on page 787.) The largest mortgage 
amount obtainable is $94,802.81. 
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9.2 FINANCIAL TABLES 



9.2.1 COMPOUND INTEREST: FIND FINAL VALUE 

These tables use Equation (9.1.2) to determine the final value in dollars (A) when 
one dollar (P = 1) is invested at an interest rate of i per time period, the length of 
investment time being n time periods. For example, if $1 is invested at a return of 
3% per time period, for 60 time periods, then the final value would be $5.89 (see the 
following table). Analogously, if $10 had been invested, then the final value would 
be $59.92. 





Interest rate (i) 


n 


1.00% 


1.50% 


2.00% 


2.50% 


3.00% 


3.50% 


2 


1.0201 


1.0302 


1.0404 


1.0506 


1.0609 


1.0712 


4 


1.0406 


1.0614 


1.0824 


1.1038 


1.1255 


1.1475 


6 


1.0615 


1.0934 


1.1262 


1.1597 


1.1941 


1.2293 


8 


1.0829 


1.1265 


1.1717 


1.2184 


1.2668 


1.3168 


10 


1.1046 


1.1605 


1.2190 


1.2801 


1.3439 


1.4106 


12 


1.1268 


1.1956 


1.2682 


1.3449 


1.4258 


1.5111 


20 


1.2202 


1.3469 


1.4860 


1.6386 


1.8061 


1.9898 


24 


1.2697 


1.4295 


1.6084 


1.8087 


2.0328 


2.2833 


36 


1.4308 


1.7091 


2.0399 


2.4325 


2.8983 


3.4503 


48 


1.6122 


2.0435 


2.5871 


3.2715 


4.1322 


5.2136 


60 


1.8167 


2.4432 


3.2810 


4.3998 


5.8916 


7.8781 


72 


2.0471 


2.9212 


4.1611 


5.9172 


8.4000 


11.9043 





Interest rate (i) 


n 


4.00% 


4.50% 


5.00% 


5.50% 


6.00% 


6.50% 


2 


1.0816 


1.0920 


1.1025 


1.1130 


1.1236 


1.1342 


4 


1.1699 


1.1925 


1.2155 


1.2388 


1.2625 


1.2865 


6 


1.2653 


1.3023 


1.3401 


1.3788 


1.4185 


1.4591 


8 


1.3686 


1.4221 


1.4775 


1.5347 


1.5938 


1.6550 


10 


1.4802 


1.5530 


1.6289 


1.7081 


1.7909 


1.8771 


12 


1.6010 


1.6959 


1.7959 


1.9012 


2.0122 


2.1291 


20 


2.1911 


2.4117 


2.6533 


2.9178 


3.2071 


3.5236 


24 


2.5633 


2.8760 


3.2251 


3.6146 


4.0489 


4.5331 


36 


4.1039 


4.8774 


5.7918 


6.8721 


8.1472 


9.6513 


48 


6.5705 


8.2715 


10.4013 


13.0653 


16.3939 


20.5485 


60 


10.5196 


14.0274 


18.6792 


24.8398 


32.9877 


43.7498 


72 


16.8423 


23.7888 


33.5451 


47.2256 


66.3777 


93.1476 
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Interest rate (i) 


n 


7 00% 


7.50% 


8.00% 


8.50% 


9.00% 


9.50% 


2 


1 1449 




1 1fSfS4 


1 1 779 


1 1 881 

1 . 1 OO 1 


1 1QQ0 


4 


1 .J 1UO 


i . j j -j -j 


1 ^fSOS 

1 .JUv/J 


1 ^8SQ 

1 .JOJy 


1 4 1 1 f, 


1 4^77 


6 


1 S007 

1 . J\A/ / 




1 S86Q 


1 6^1 S 


1 6771 


1 79^8 


8 


1 718? 


1 78^S 

1 . / OJJ 


1 8S0Q 

1 .OJU7 




1 QQ?fS 


i.UUU? 


10 


1 9671 


2 0610 


9 1 589 

Z,. 1J07 


2.2610 


Z. _JU / i 


2.4782 


12 


9 9S99 

Z,.Z,.J Z,Z, 


9 ^81 8 

Z.JO 1 o 


9 S1 8? 

Z.J 1 oz 


9 fifi17 

i.UU 1 / 


9 R197 

Z. O 1 Z / 


9 Q71 S 


20 


3.8697 


4.2478 


4.6610 


5.1120 


5.6044 


6.1416 


24 


5.0724 


5.6729 


6.3412 


7.0846 


7.9111 


8.8296 


36 


11.4239 


13.5115 


15.9682 


18.8569 


22.2512 


26.2366 


48 


25.7289 


32.1815 


40.2106 


50.1912 


62.5852 


77.9611 


60 


57.9464 


76.6492 


101.2571 


133.5932 


176.0313 


231.6579 


72 


130.5065 


182.5616 


254.9825 


355.5831 


495.1170 


688.3615 





Interest rate (i) 


n 


10.00% 


10.50% 


11.00% 


11.50% 


12.00% 


12.50% 


2 


1.2100 


1.2210 


1.2321 


1.2432 


1.2544 


1.2656 


4 


1.4641 


1.4909 


1.5181 


1.5456 


1.5735 


1.6018 


6 


1.7716 


1.8204 


1.8704 


1.9215 


1.9738 


2.0273 


8 


2.1436 


2.2228 


2.3045 


2.3889 


2.4760 


2.5658 


10 


2.5937 


2.7141 


2.8394 


2.9699 


3.1059 


3.2473 


12 


3.1384 


3.3140 


3.4985 


3.6923 


3.8960 


4.1099 


20 


6.7275 


7.3662 


8.0623 


8.8206 


9.6463 


10.5451 


24 


9.8497 


10.9823 


12.2392 


13.6332 


15.1786 


16.8912 


36 


30.9127 


36.3950 


42.8181 


50.3379 


59.1356 


69.4210 


48 


97.0172 


120.6117 


149.7970 


185.8633 


230.3908 


285.3127 


60 


304.4816 


399.7023 


524.0572 


686.2653 


897.5969 


1 172.6039 


72 


955.5938 


1324.5978 


1833.3884 


2533.9057 


3497.0161 


4819.2740 





Interest rate (i) 


n 


13.00% 


13.50% 


14.00% 


14.50% 


15.00% 


15.50% 


2 


1.2769 


1.2882 


1.2996 


1.3110 


1.3225 


1.3340 


4 


1.6305 


1.6595 


1.6890 


1.7188 


1.7490 


1.7796 


6 


2.0819 


2.1378 


2.1950 


2.2534 


2.3131 


2.3741 


8 


2.6584 


2.7540 


2.8526 


2.9542 


3.0590 


3.1671 


10 


3.3946 


3.5478 


3.7072 


3.8731 


4.0456 


4.2249 


12 


4.3345 


4.5704 


4.8179 


5.0777 


5.3502 


5.6362 


20 


11.5231 


12.5869 


13.7435 


15.0006 


16.3665 


17.8501 


24 


18.7881 


20.8882 


23.2122 


25.7829 


28.6252 


31.7664 


36 


81.4374 


95.4665 


111.8342 


130.9174 


153.1518 


179.0406 


48 


352.9923 


436.3162 


538.8066 


664.7577 


819.4007 


1009.1024 


60 


1530.0535 


1994.1218 


2595.9187 


3375.4307 


4383.9987 


5687.4691 
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9.2.2 COMPOUND INTEREST: FIND INTEREST RATE 



These tables use Equation (9. 1.2) to determine the compound interest rate i that must 
be obtained from an investment of one dollar (P = 1) to yield a final value of A (in 
dollars) when the initial amount is invested for n time periods. For example, if $1 is 
invested for 60 time periods, and the final amount obtained is $4.00, then the actual 
interest rate has been 2.34% per time period (see the following table). Analogously, 
if $ 100 had been invested, and the final amount was $400, then the interest rate would 
also be 2.34% per time period. 





Annuity (A) 


n 


2.0 


2.5 


3.0 


3.5 


4.0 


4.5 


1 


100.00 


150.00 


200.00 


250.00 


300.00 


350.00 


2 


41.42 


58.11 


73.20 


87.08 


100.00 


112.13 


3 


25.99 


35.72 


44.23 


51.83 


58.74 


65.10 


4 


18.92 


25.74 


31.61 


36.78 


41.42 


45.65 


5 


14.87 


20.11 


24.57 


28.47 


31.95 


35.10 


10 


7.18 


9.60 


11.61 


13.35 


14.87 


16.23 


12 


5.95 


7.93 


9.59 


11.00 


12.25 


13.35 


20 


3.53 


4.69 


5.65 


6.46 


7.18 


7.81 


24 


2.93 


3.89 


4.68 


5.36 


5.95 


6.47 


36 


1.94 


2.58 


3.10 


3.54 


3.93 


4.27 


48 


1.46 


1.93 


2.31 


2.64 


2.93 


3.18 


60 


1.16 


1.54 


1.85 


2.11 


2.34 


2.54 


72 


0.97 


1.28 


1.54 


1.75 


1.94 


2.11 






Annuity (A) 


n 


5.0 


5.5 


6.0 


6.5 


7.0 


7.5 


1 


400.00 


450.00 


500.00 


550.00 


600.00 


650.00 


2 


123.61 


134.52 


144.95 


154.95 


164.57 


173.86 


3 


71.00 


76.52 


81.71 


86.63 


91.29 


95.74 


4 


49.53 


53.14 


56.51 


59.67 


62.66 


65.49 


5 


37.97 


40.63 


43.10 


45.41 


47.58 


49.63 


10 


17.46 


18.59 


19.62 


20.58 


21.48 


22.32 


12 


14.35 


15.27 


16.10 


16.88 


17.61 


18.28 


20 


8.38 


8.90 


9.37 


9.81 


10.22 


10.60 


24 


6.94 


7.36 


7.75 


8.11 


8.45 


8.76 


36 


4.57 


4.85 


5.10 


5.34 


5.55 


5.76 


48 


3.41 


3.62 


3.80 


3.98 


4.14 


4.29 


60 


2.72 


2.88 


3.03 


3.17 


3.30 


3.42 


72 


2.26 


2.40 


2.52 


2.63 


2.74 


2.84 
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Annuity (A) 


n 


8.0 


8.5 


9.0 


9.5 


10.0 


10.5 


1 


700 00 

/ WW. WW 


7S0 00 

/ JW.WW 


800 00 

OWW. WW 


8 SO 00 

OJv.W 


Q00 00 

"WW. WW 


QS0 00 


2 


1 89 84. 


i y i — 


900 00 

Z.WW.WW 


908 99 


916 9^ 


994 04 


3 


1 00 00 

1 WW. WW 


1 04. 08 

1 Wt^.WO 


1 08 01 

1 WO.W1 


111 VQ 

111./" 


1 1 S 44 

1 U .11 


1 1 8 Q8 

1 10.70 


4 


68 1 8 

WO. 1 o 


70 7S 
/ w. / J 


7^ 90 


75 SfS 


77 8^ 


80 01 

OW.Wl 


5 


51 57 


53 42 


55 19 


56 87 


58 49 


60 04 


10 


0% 1 1 

. 1 1 


7^ 86 


74 S7 


Z J .Z J 


7S 8Q 


Z.U.J 1 


12 


1 8 Q7 






70 64 

Z/U-Ut 


71 1 S 

Z, 1 . u 


Z,l .UJ 


20 


10.96 


11.29 


11.61 


11.91 


12.20 


12.48 


24 


9.05 


9.33 


9.59 


9.83 


10.07 


10.29 


36 


5.95 


6.12 


6.29 


6.45 


6.61 


6.75 


48 


4.43 


4.56 


4.68 


4.80 


4.91 


5.02 


60 


3.53 


3.63 


3.73 


3.82 


3.91 


4.00 


72 


2.93 


3.02 


3.10 


3.18 


3.25 


3.32 





Annuity (A) 


n 


11.0 


12.0 


13.0 


14.0 


15.0 


16.0 


1 


1000.00 


1100.00 


1200.00 


1300.00 


1400.00 


1500.00 


2 


231.66 


246.41 


260.56 


274.17 


287.30 


300.00 


3 


122.40 


128.94 


135.13 


141.01 


146.62 


151.98 


4 


82.12 


86.12 


89.88 


93.43 


96.80 


100.00 


5 


61.54 


64.38 


67.03 


69.52 


71.88 


74.11 


10 


27.10 


28.21 


29.24 


30.20 


31.10 


31.95 


12 


22.12 


23.01 


23.83 


24.60 


25.32 


25.99 


20 


12.74 


13.23 


13.68 


14.11 


14.50 


14.87 


24 


10.51 


10.91 


11.28 


11.62 


11.95 


12.25 


36 


6.89 


7.15 


7.38 


7.61 


7.81 


8.01 


48 


5.12 


5.31 


5.49 


5.65 


5.80 


5.95 


60 


4.08 


4.23 


4.37 


4.50 


4.62 


4.73 


72 


3.39 


3.51 


3.63 


3.73 


3.83 


3.93 



n 


Annuity ( A) 


17.0 


18.0 


19.0 


20.0 


25.0 


30.0 


1 


1600.00 


1700.00 


1800.00 


1900.00 


2400.00 


2900.00 


2 


312.31 


324.26 


335.89 


347.21 


400.00 


447.72 


3 


157.13 


162.07 


166.84 


171.44 


192.40 


210.72 


4 


103.05 


105.98 


108.78 


111.47 


123.61 


134.03 


5 


76.23 


78.26 


80.20 


82.06 


90.36 


97.44 


10 


32.75 


33.51 


34.24 


34.93 


37.97 


40.51 


12 


26.63 


27.23 


27.81 


28.36 


30.77 


32.77 


20 


15.22 


15.55 


15.86 


16.16 


17.46 


18.54 


24 


12.53 


12.80 


13.05 


13.29 


14.35 


15.22 


36 


8.19 


8.36 


8.52 


8.68 


9.35 


9.91 


48 


6.08 


6.21 


6.33 


6.44 


6.94 


7.34 


60 


4.83 


4.93 


5.03 


5.12 


5.51 


5.83 


72 


4.01 


4.10 


4.17 


4.25 


4.57 


4.84 
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9.2.3 COMPOUND INTEREST: FIND ANNUITY 



These tables use Equation (9.1.4) to determine the annuity (or mortgage) payment 
that must be paid each time period, for n time periods, at an interest rate of i% per 
time period, to pay off a loan of one dollar (B = 1). For example, if $1 is borrowed 
at 3% interest per time period, and the amount is to be paid back in equal amounts 
over 10 time periods, then the amount paid back per time period is $0. 12 (see the fol- 
lowing table). Analogously, if $100 had been borrowed, then the mortgage amount 
would be $11.72. 





Interest rate (i) 


n 


2.00% 


2.25% 


2.50% 


2.75% 


3.00% 


3.25% 


1 


1.0200 


1.0225 


1.0250 


1.0275 


1.0300 


1.0325 


2 


0.5151 


0.5169 


0.5188 


0.5207 


0.5226 


0.5245 


3 


0.3468 


0.3484 


0.3501 


0.3518 


0.3535 


0.3552 


4 


0.2626 


0.2642 


0.2658 


0.2674 


0.2690 


0.2706 


5 


0.2122 


0.2137 


0.2152 


0.2168 


0.2183 


0.2199 


6 


0.1785 


0.1800 


0.1815 


0.1831 


0.1846 


0.1861 


7 


0.1545 


0.1560 


0.1575 


0.1590 


0.1605 


0.1620 


8 


0.1365 


0.1380 


0.1395 


0.1410 


0.1425 


0.1440 


9 


0.1225 


0.1240 


0.1255 


0.1269 


0.1284 


0.1299 


10 


0.1113 


0.1128 


0.1143 


0.1157 


0.1172 


0.1187 


12 


0.0946 


0.0960 


0.0975 


0.0990 


0.1005 


0.1020 


20 


0.0612 


0.0626 


0.0641 


0.0657 


0.0672 


0.0688 


24 


0.0529 


0.0544 


0.0559 


0.0575 


0.0590 


0.0607 


36 


0.0392 


0.0408 


0.0425 


0.0441 


0.0458 


0.0475 


72 


0.0263 


0.0282 


0.0301 


0.0320 


0.0340 


0.0361 





Interest rate (i) 


n 


3.50% 


3.75% 


4.00% 


4.25% 


4.50% 


4.75% 


1 


1.0350 


1.0375 


1.0400 


1.0425 


1.0450 


1.0475 


2 


0.5264 


0.5283 


0.5302 


0.5321 


0.5340 


0.5359 


3 


0.3569 


0.3586 


0.3604 


0.3621 


0.3638 


0.3655 


4 


0.2722 


0.2739 


0.2755 


0.2771 


0.2787 


0.2804 


5 


0.2215 


0.2230 


0.2246 


0.2262 


0.2278 


0.2294 


6 


0.1877 


0.1892 


0.1908 


0.1923 


0.1939 


0.1955 


7 


0.1635 


0.1651 


0.1666 


0.1681 


0.1697 


0.1713 


8 


0.1455 


0.1470 


0.1485 


0.1501 


0.1516 


0.1532 


9 


0.1315 


0.1330 


0.1345 


0.1360 


0.1376 


0.1391 


10 


0.1202 


0.1218 


0.1233 


0.1248 


0.1264 


0.1279 


12 


0.1035 


0.1050 


0.1066 


0.1081 


0.1097 


0.1112 


20 


0.0704 


0.0720 


0.0736 


0.0752 


0.0769 


0.0785 


24 


0.0623 


0.0639 


0.0656 


0.0673 


0.0690 


0.0707 


36 


0.0493 


0.0511 


0.0529 


0.0547 


0.0566 


0.0585 


72 


0.0382 


0.0403 


0.0425 


0.0447 


0.0470 


0.0492 
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Interest rate (i) 


n 


5 00% 


5.25% 


5.50% 


5.75% 


6.00% 


6.25% 


1 


1 osoo 


1 0S9S 


1 OS so 


1 057S 


1 OfSOO 

1 . UUUv 


1 0fi9 S 

1 .UUiJ 


2 


W.J J 1 o 


U.JJ7 / 




W — ItJJ 


S4S4 


S474 


3 


^679 


U.JUU7 


^706 

W.J / Uu 


^794 


^741 


^7S8 

\J.J / JO 


4 




98^7 


98S^ 

U.iOJJ 


986Q 


9886 

U.iOOU 


9Q0^ 


5 


231 


0.2326 


0.2342 


9358 


9374 


9390 


6 


1 Q70 
w. i ~ / w 


W. 1 70U 


900? 


901 8 


90^4 


90S0 


7 


1 778 

W. 1 / Z.O 


1744 


1760 


1776 
w. 1 1 1 w 


17Q1 

W. 1 / "l 


1 807 

W. lOW / 


8 


1 S47 
w. i jt / 


v/. 1JUJ 


1 S7Q 


1 SQS 

W. 1J7J 


W. lUlU 


1696 

W. 1UZ,U 


9 


1407 

w . 1 / 


149^ 


14^8 


14S4 

w. Itjt 


1470 


1486 

W. ItOU 


10 


0.1295 


0.1311 


0.1327 


0.1343 


0.1359 


0.1375 


12 


0.1128 


0.1144 


0.1160 


0.1177 


0.1193 


0.1209 


20 


0.0802 


0.0819 


0.0837 


0.0854 


0.0872 


0.0890 


24 


0.0725 


0.0742 


0.0760 


0.0779 


0.0797 


0.0815 


36 


0.0604 


0.0624 


0.0644 


0.0664 


0.0684 


0.0704 


72 


0.0515 


0.0539 


0.0562 


0.0585 


0.0609 


0.0633 





Interest rate (i) 


n 


6.50% 


6.75% 


7.00% 


7.25% 


7.50% 


7.75% 


1 


1.0650 


1.0675 


1.0700 


1.0725 


1.0750 


1.0775 


2 


0.5493 


0.5512 


0.5531 


0.5550 


0.5569 


0.5588 


3 


0.3776 


0.3793 


0.3810 


0.3828 


0.3845 


0.3863 


4 


0.2919 


0.2936 


0.2952 


0.2969 


0.2986 


0.3002 


5 


0.2406 


0.2423 


0.2439 


0.2455 


0.2472 


0.2488 


6 


0.2066 


0.2082 


0.2098 


0.2114 


0.2130 


0.2147 


7 


0.1823 


0.1839 


0.1855 


0.1872 


0.1888 


0.1904 


8 


0.1642 


0.1658 


0.1675 


0.1691 


0.1707 


0.1724 


9 


0.1502 


0.1519 


0.1535 


0.1551 


0.1568 


0.1584 


10 


0.1391 


0.1407 


0.1424 


0.1440 


0.1457 


0.1474 


12 


0.1226 


0.1242 


0.1259 


0.1276 


0.1293 


0.1310 


20 


0.0908 


0.0926 


0.0944 


0.0962 


0.0981 


0.1000 


24 


0.0834 


0.0853 


0.0872 


0.0891 


0.0911 


0.0930 


36 


0.0725 


0.0746 


0.0767 


0.0789 


0.0810 


0.0832 


72 


0.0657 


0.0681 


0.0705 


0.0730 


0.0754 


0.0779 
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Interest rate (i) 


n 


8 00% 


8.25% 


8.50% 


8.75% 


9.00% 


9.25% 


1 


1 0800 


1 08? S 


1 08 SO 


1 087S 

1 .WO / -J 


1 0Q00 


1 0Q9S 


2 


S608 

U.JUUO 


Sfi?7 




SfifiS 


SfiSS 


S704. 

W.J / Irt 


3 


^880 

W.JOOu 


^8Q8 

U.J070 


^Q1 S 


o ^Q^n 

V/.J7JJ 


^QS1 
w. jy~j i 


^Qfi8 

V.J7UO 


4 


^01 Q 


^O^fi 

W. JUJU 


^OS^ 


^070 


^087 


^1 04. 

W.J 1 Wt^ 


5 


9 SOS 


0.2521 


?538 


?SS4 


2571 


?S88 


6 


91M 


91 80 


91 Q6 


991 ^ 


999Q 


9946 


7 


1 Q91 


1Q^7 
w. i / 


1QS4 


1 Q70 


1Q87 


9004 


8 


1 740 


17S7 

W. 1 / u l 


177^ 


1 7Q0 


1807 


1 894 


9 


1 601 


W. iuio 


1M4 


1 6S1 


1668 

\J. 1UUO 


168S 

W. 1UOJ 


10 


0.1490 


0.1507 


0.1524 


0.1541 


0.1558 


0.1575 


12 


0.1327 


0.1344 


0.1361 


0.1379 


0.1396 


0.1414 


20 


0.1018 


0.1037 


0.1057 


0.1076 


0.1095 


0.1115 


24 


0.0950 


0.0970 


0.0990 


0.1010 


0.1030 


0.1051 


36 


0.0853 


0.0875 


0.0898 


0.0920 


0.0942 


0.0965 


72 


0.0803 


0.0828 


0.0852 


0.0877 


0.0902 


0.0927 





Interest rate (i) 


n 


9.50% 


10.00% 


10.50% 


11.00% 


11.50% 


12.00% 


1 


1.0950 


1.1000 


1.1050 


1.1100 


1.1150 


1.1200 


2 


0.5723 


0.5762 


0.5801 


0.5839 


0.5878 


0.5917 


3 


0.3986 


0.4021 


0.4057 


0.4092 


0.4128 


0.4163 


4 


0.3121 


0.3155 


0.3189 


0.3223 


0.3258 


0.3292 


5 


0.2604 


0.2638 


0.2672 


0.2706 


0.2740 


0.2774 


6 


0.2263 


0.2296 


0.2330 


0.2364 


0.2398 


0.2432 


7 


0.2020 


0.2054 


0.2088 


0.2122 


0.2157 


0.2191 


8 


0.1840 


0.1874 


0.1909 


0.1943 


0.1978 


0.2013 


9 


0.1702 


0.1736 


0.1771 


0.1806 


0.1841 


0.1877 


10 


0.1593 


0.1628 


0.1663 


0.1698 


0.1734 


0.1770 


12 


0.1432 


0.1468 


0.1504 


0.1540 


0.1577 


0.1614 


20 


0.1135 


0.1175 


0.1215 


0.1256 


0.1297 


0.1339 


24 


0.1071 


0.1113 


0.1155 


0.1198 


0.1241 


0.1285 


36 


0.0988 


0.1033 


0.1080 


0.1126 


0.1173 


0.1221 


72 


0.0951 


0.1001 


0.1051 


0.1101 


0.1150 


0.1200 
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Interest rate (i) 


n 




13.00% 


13.50% 


14.00% 


14.50% 


1 5 00% 


1 




1 1 ^00 


1 1 ^so 


1 1400 


1 14S0 


1 1 soo 


2 


U.J7JU 






607^ 


6119 


fS1 S1 


3 


4.1 QQ 


49^S 


4.971 


4^07 


4^44 


4^80 


4 




^69 


^Q7 


^4^9 


^467 


^SO^ 


5 


9808 

V_/ . zL O V./ O 


2843 


0.2878 


991 3 


9948 


9983 


6 




9S01 




9S79 


9607 


9649 


7 


9996 


9961 

\J . 1 






9^68 

U.Z.JUO 


9404 


8 


9048 






91 Sfi 


91Q9 


9998 


9 


1 Q1 ^ 


1Q4Q 


\J. 1 70J 


9099 


90SQ 


90Q6 


10 


0.1806 


0.1843 


0.1880 


0.1917 


0.1955 


0.1993 


12 


0.1652 


0.1690 


0.1728 


0.1767 


0.1806 


0.1845 


20 


0.1381 


0.1424 


0.1467 


0.1510 


0.1554 


0.1598 


24 


0.1329 


0.1373 


0.1418 


0.1463 


0.1509 


0.1554 


36 


0.1268 


0.1316 


0.1364 


0.1413 


0.1461 


0.1510 


72 


0.1250 


0.1300 


0.1350 


0.1400 


0.1450 


0.1500 






Interest rate (i) 


n 


15.50% 


16.00% 


16.50% 


17.00% 


17.50% 


18.00% 


1 


1.1550 


1.1600 


1.1650 


1.1700 


1.1750 


1.1800 


2 


0.6190 


0.6230 


0.6269 


0.6308 


0.6348 


0.6387 


3 


0.4416 


0.4453 


0.4489 


0.4526 


0.4562 


0.4599 


4 


0.3538 


0.3574 


0.3609 


0.3645 


0.3681 


0.3717 


5 


0.3019 


0.3054 


0.3090 


0.3126 


0.3162 


0.3198 


6 


0.2678 


0.2714 


0.2750 


0.2786 


0.2823 


0.2859 


7 


0.2440 


0.2476 


0.2513 


0.2550 


0.2586 


0.2624 


8 


0.2265 


0.2302 


0.2339 


0.2377 


0.2415 


0.2452 


9 


0.2133 


0.2171 


0.2209 


0.2247 


0.2285 


0.2324 


10 


0.2031 


0.2069 


0.2108 


0.2147 


0.2186 


0.2225 


12 


0.1884 


0.1924 


0.1964 


0.2005 


0.2045 


0.2086 


20 


0.1642 


0.1687 


0.1732 


0.1777 


0.1822 


0.1868 


24 


0.1600 


0.1647 


0.1693 


0.1740 


0.1787 


0.1835 


36 


0.1559 


0.1608 


0.1657 


0.1706 


0.1755 


0.1805 


72 


0.1550 


0.1600 


0.1650 


0.1700 


0.1750 


0.1800 
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8.2 NUMERICAL LINEAR ALGEBRA 



8.2.1 Solving linear systems 

8.2.2 Gaussian elimination 

8.2.3 Gaussian elimination algorithm 

8.2.4 Pivoting 

8.2.5 Eigenvalue computation 

8.2.6 Householder's method 

8.2.7 QR algorithm 

8.2.8 Non-linear systems and numerical optimization 



8.3 NUMERICAL INTEGRATION AND DIFFERENTIATION 
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The text Numerical Analysis, Seventh Edition, Brooks/Cole, Pacific Grove, CA, 
2001, by R. L. Burden and J. D. Faires, was the primary reference for most of the 
information presented in this chapter. 
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8.1 BASIC NUMERICAL ANALYSIS 



8.1 .1 APPROXIMATIONS AND ERRORS 

Numerical methods involve nding approximate solutions to mathematical prob- 
lems. Errors of approximation can result from two sources: error inherent in the 
method or formula used and round-off error. Round- off error results when a calcu- 
lator or computer is used to perform real-number calculations with a nite number 
of signi cant digits. All but the rst speci ed number of digits are either chopped or 
rounded to that number of digits. 

If p* is an approximation to p, the absolute error is de ned to be \p — p* | and 
the relative error is \p — p*\/\p\, provided that p ^ 0. 

Iterative techniques often generate sequences that (ideally) converge to an exact 
solution. It is sometimes desirable to describe the rate of convergence. 

DEFINITION 8.1.1 

Suppose lim /?„ = 0and\ima n = a. If a positive constant K exists with \a n — a\ < 
K |/?„| for large n, then {a n } is said to converge to a with a rate of convergence 
0(P n ). This is read "big oh of j3 n " and written a n = a + 0(P n ). 



DEFINITION 8.1.2 

Suppose {p n } is a sequence that converges to p, with p n ^ p, for all n. If positive 
constants A and a exist with lim — = A, then {p n \ converges to p of 

n->oo \p n -p\ 

order a, with asymptotic error constant A. 

In general, a higher order of convergence yields a more rapid rate of conver- 
gence. A sequence has linear convergence if a = 1 and quadratic convergence if 
a = 2. 

8.1 .1 .1 Aitken's A 2 method 
DEFINITION 8.1.3 

Given {p„}^ , the forward difference Ap n is de ned by Ap n = p n +i — p n > for 
n > 0. Higher powers A k p n are de n ed recursively by A k p n = A(A k ~ 1 p n ), for 
k>2. In particular, A 2 p n = A(p n+1 - p n ) = p n+2 - 2p n+1 + p n . 

If a sequence {p n } converges linearly to p and (p n — p)(p n _i — p) > 0, for 
suf ciently large n, then the new sequence {p n } generated by called Aitken's A 2 
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method, 



(Ap„) 2 

Pn=Pn--To (8.1.1) 

^ Pn 



for all n > 0, satis es lim„_ i . 00 — — — = 0. 

Pn ~ P 

8.1 .1 .2 Richardson's extrapolation 

Improved accuracy can be achieved by combining extrapolation with a low-order 
formula. Suppose the unknown value M is approximated by a formula N(h) for 
which 

M = N(h) + K 1 h + K 2 h 2 + K 3 h 3 + ... (8.1.2) 

for some unspeci ed constants K\ , K 2 , K 3 , . . . . To apply extrapolation, set N\ (h) = 
N(h), and generate new approximations Nj(h) by 

Njih) = + 3 yU_{ - (8.1.3) 

Then M = Nj(h) + 0(/i J ). A table of the following form is generated, one row at 
a time: 

iVi( h /2) W 2 (h) 

iVi(tyO iV 2 ( h /2) JVaW 

iVl( h /8) ^2( h A) ^3( h /2) iv 4 (ft). 

Extrapolation can be applied whenever the truncation error for a formula has the 
form YJ^Ji Kjh a ' + 0(h a ™) for constants Kj and a x < a 2 < ■ ■ ■ < a m . In 
particular, if aj = 2j, the following computation can be used: 

and the entries in the j th column of the table have order 0(/i 2j ). 



8.1 .2 SOLUTION TO ALGEBRAIC EQUATIONS 

Iterative methods generate sequences {p n } that converge to a solution p of an equa- 
tion. 

DEFINITION 8.1.4 

A solution p off(x) = is a zero of multiplicity m iff(x) can be written as f(x) = 
(x — p) m q(x), for x ^ p, where \im x ^ p q(x) ^ 0. A zero is called simple ifm = 1. 
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8.1.2.1 Fixed point iteration 

A xed point p for a function g satis es g(p) = p. Given p , generate {p n } by 

Pn+i = g(Pn) forn > 0. (8.1.5) 

If {p n } converges, then it will converge to a x ed point of g and the value p n can 
be used as an approximation for p. The following theorem gives conditions that 
guarantee convergence. 

THEOREM8.1.1 ( Fixed point theorem ) 

Let g £ C[a, b] and suppose that g(x) £ [a, b] for all x in [a, b]. Suppose also that 
g' exists on (a, b) with \g' {x)\ < k < 1, for all x £ (a, b). If po is any number 
in [a,b], then the sequence de ne d by Equation (8.1.5) converges to the (unique) 
xed point p in [a,b]. Both of the error estimates \p n — p\ < j-bjr \p — p x \ and 
\Pn — p\ < k n max{po — a,b — po} hold, for all n > 1. 

The iteration sometimes converges even if the conditions are not all satis ed. 
THEOREM 8.1 .2 

Suppose g is a function that satis es the conditions of Theorem 8.1.1 and g' is also 
continuous on (a,b). Ifg'(p) ^ 0, then for any number po in [a,b], the sequence 
generated by Equation (8.1.5) converges only linearly to the unique xed point p in 
[a,b\ 



THEOREM 8.1 .3 

Let p be a solution of the equation x = g(x). Suppose that g'(p) = and g" are 
continuous and bounded by a constant on an open interval I containing p. Then 
there exists a 6 > such that, for p £ [p — 5,p + 5], the sequence de n ed by 
Equation (8.1.5) converges at least quadratically to p. 

8.1.2.2 Steffensen's method 

For a linearly convergent x ed-point iteration, convergence can be accelerated by 
applying Aitken's A 2 method. This is called Steffensen's method. De ne p^ = po, 
compute p = g(p^) andp^ = g(p^). Set^Q 1 ' = po which is computed using 
Equation (8.1.1) applied to p^ , p^ , and p^ . Use x ed-point iteration to compute 
p^ andp^ 1 ' and then Equation (8.1.1) to nd p^ . Continuing, generate {pq™'}. 

THEOREM 8.1 .4 

Suppose that x = g(x) has the solution p with g' (p) ^ 1. If there exists a S > such 
that g £ C 3 [p — S, p + S], then Steffensen's method gives quadratic convergence for 
the sequence {p^ } for any po £ [p — 6, p + S] . 
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FIGURE 8.1 

Illustration of Newton's method} 




8.1.2.3 Newton-Raphson method (Newton's method) 

To solve f(x) = 0, given an initial approximation po, generate {p n } using 

p n+ i=p n -^\, forn>0. (8.1.6) 

f (Pn) 

Figure 8.1 describes the method geometrically. Each value p n +i represents the 
^-intercept of the tangent line to the graph of f(x) at the point [p n , / (p n )]. 

THEOREM 8.1 .5 

Let f £ C 2 [a, b]. If p G [a, b] is such that f(p) = and f'(p) ^ 0, then there exists 
a 8 > such that Newton's method generates a sequence {p n } converging to pfor 
any initial approximation po € [p — 6, p + 6]. 

Note: 

1. Generally the conditions of the theorem cannot be checked. Therefore one 
usually generates the sequence {p n } and observes whether or not it converges. 

2. An obvious limitation is that the iteration terminates if f'(p n ) = 0. 

3. For simple zeros of /, Theorem 8.1.5 implies that Newton's method converges 
quadratically. Otherwise, the convergence is much slower. 



'From R.L. Burden and J.D. Faires, Numerical Analysis, 7th ed., Brooks/Cole, Paci c Grove, CA, 
2001. With permission. 
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8.1.2.4 Modi ed Newton's method 

Newton's method converges only linearly if p has multiplicity larger than one. How- 
ever, the function u(x) = j^ry has a simple zero at p. Hence, the Newton iteration 
formula applied to u(x) yields quadratic convergence to a root of f(x) = 0. The 
iteration simpli es to 

fi.Pn)f {.Pn) t ^ n 1 -7\ 

Pn+1=Pn -[f( Pn )?-f( Pn )n Pn y forn -°- (8 ' L7) 

8.1.2.5 Secant method 

To solve f(x) = 0, the secant method uses the ^-intercept of the secant line passing 
through (p n , f{pn)) and (p n -i , f(p n -i))- The derivative of / is not needed. Given 
Po and p\ , generate the sequence with 

p n+1 =p n -f(p n ) J Pn ~ Pn - l) forn>l. (8.1.8) 

f{Pn) ~ f(Pn-l) 



8.1.2.6 Root-bracketing methods 

Suppose f(x) is continuous on [a, b] and f(a)f(b) < 0. The Intermediate Value 
Theorem guarantees a number p € (a, b) exists with f(p) = 0. A root-bracketing 
method constructs a sequence of nested intervals [a n , b„], each containing a solution 
of f{x) = 0. At each step, compute p n € [a„,6„] and proceed as follows: 

If f(p n ) = 0, stop the iteration and p = p n . 

Else, 

if f(a n )f(Pn) < 0, then set a n+1 = a n , b n+1 = p n . 
Else, set a n+1 = p n , b n+1 = b n . 



8.1.2.7 Bisection method 

This is a special case of the root-bracketing method. The values p „ are computed by 

b n ~ (In a n "I" b n 

Pn = a„ + = , forn > 1. (8.1.9) 

Clearly, \p n — p\ < (b — a)/2 n for n > 1. The rate of convergence is 0(2~ n ). 
Although convergence is slow, the exact number of iterations for a speci ed accuracy 
e can be determined. To guarantee that \pw — p\ < e, use 

(b — a\ ln(6 — a) — In e 
J V>lo ga ( — )=-L_i . (8.1.10) 



8.1 .2.8 False position (regula falsi) 

i. six, \ b n — Cl n 
Pn=b„- f(0 n )-F77—\ JT 

This root-bracketing method also converges if the initial criteria are satis ed. 



Pn = b n - f{b n )-nr\ — rr^"' fom>i. (8.1.1 1) 

SiK) - f(a n ) 
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8.1 .2.9 Horner's method with de ation 

If Newton's method is used to solve for roots of the polynomial P(x) = 0, then 
the polynomials P and P' are repeatedly evaluated. Horner's method ef ciently 
evaluates a polynomial of degree n using only n multiplications and n additions. 

8.1.2.10 Horner's algorithm 

To evaluate P(x) = a n x n + a n -\x n ~ l + . . . + cio and its derivative at xq\ 
INPUT: degree n, coef cien ts {ao, ai, • • • , a n }; xq, 
OUTPUT: y = P(x ); z = P'(x ). 
Algorithm: 

1. Sety = a n ; z = a n . 

2. For j = n - l,n - 2, . . . , 1, 

set y = xoy + ay, z = xqz + y. 

3. Set y = x y + a . 

4. OUTPUT (y, z). STOP. 

When satis ed with the approximation x\ for a root x\ of P, use synthetic 
division to compute Qi(x) so that P(x) £s (x — x\ ) Q i (x) . Estimate a root of Q i (x) 
and write P(x) (x — x\){x — X2)Q2{x), and so on. Eventually, Q n -i{x) will be 
a quadratic, and the quadratic formula can be applied. This procedure, nding one 
root at a time, is called de a Hon. 

Note: Care must be taken since x\ is an approximation for x\ . Some inaccuracy 
occurs when computing the coef cients of Q i (x), etc. Although the estimate xi of a 
root of Qi(x) can be very accurate, it may not be as accurate when estimating a root 
ofP(x). 



8.1.3 INTERPOLATION 

Interpolation involves tting a function to a set of data points (xo,yo), {x\,y\), 
■ ■ ■ » {x n ,Vn)- The Xi are unique and the may be regarded as the values of some 
function f{x), that is, = f{xi) for i = 0, 1, . . . , n. The following are polynomial 
interpolation methods. 

8.1.3.1 Lagrange interpolation 

The Lagrange interpolating polynomial, denoted P n (x), is the unique polynomial of 
degree at most n for which P n {xk) = f{xk) for k = 0, 1, . . . , n. It is given by 

n 
k=0 



© 2003 by CRC Press LLC 



where {xo, . . . , x n } are called node points, and 

(x - x )(x - xi) ■ ■ ■ (x - x k -i)(x - Xk+i) ■■■(x-x n ) 



L n ,k(x) 



(x k - x Q )(x k - xi) ■ ■ ■ (x k - Xk-i)(x k - Xk+i) ■■■{xk- x n ) 
II } X ~_ Xi \ ■ for* = 0,1,..., n. (8.1.13) 



THEOREM 8.1.6 {Error formula) 

If Xo,Xi, ... ,x n are distinct numbers in [a, b] and f € C n+1 [a, b], then, for each x 
in [a, b], a number ^(x) in (a, b) exists with 

f( x ) = P ( x ) + J ^ \, (x - xo)(x - Xl )---(x- x n ), (8.1.14) 
(n + 1)\ 

where P is the interpolating polynomial given in Equation (8.1.12). 

Although the Lagrange polynomial is unique, it can be expressed and evaluated 
in several ways. Equation (8.1.12) is tedious to evaluate, and including more nodes 
affects the entire expression. Neville's method evaluates the Lagrange polynomial at 
a single point without explicitly ndin g the polynomial and the method adapts easily 
when new nodes are included. 



8.1.3.2 Neville's method 

Let P mi ,m 2 ,..., ms , denote the Lagrange polynomial using distinct nodes {x mi , x m2 , 
. . . , x mk }. If P(x) denotes the Lagrange polynomial using nodes {xq, x\ , . . . , Xk} 
and Xi and xj are two distinct numbers in this set, then 

p/ n _ ( x ~ Xj)Pp,l,...,j-l,j+l,...A X ) ~( X ~ Xj)Po,l,...,i-l,i+l,...,k(x) 
r[X) — ( _ \ 

\Xi Xj ) 

(8.1.15) 



8.1.3.3 Neville's algorithm 

Generate a table of entries Qij for j > and < i < j where the terms are 
Qij = Pi_j ti _j + i t ... ti _i ti . Calculations use Equation (8.1.15) for a speci c value 
of x as shown: 



xq Qo,o = Pq 

x\ Qi,o = Pi Qi,i = -Po,i 

Xi Qlfi = Pi Ql,\ = Pl,2 Ql,2 = Po,l,2 

Xz Qzfi = Pz Qz,l = ^2,3 Qz,2 = -Pi, 2, 3 Q3,3 = ^0,1,2,3 

Note that Pf. = Pk(x) = f{xu) and {Qi t {\ represents successive estimates of f(x) 
using Lagrange polynomials. Nodes may be added until \Q iti — Q i _i >i _i| < e as 
desired. 



© 2003 by CRC Press LLC 



8.1.3.4 Divided differences 

Some interpolation formulae involve divided differences. Given an ordered sequence 
of values, {x{\, and the corresponding function values f{xi), the zero th divided dif- 
ference is f[xi] = f{xi). The r st divided difference is de ned by 



f[x% , x 



i+lj 



/(x i+ i) - f(Xi) _ f[x i+1 ] - f[Xi] 



X%-\-\ Xi Xj t s r \ Xi 

The k' h divided difference is de ned by 



(8.1.16) 



= f[x i + 1 ,X i +2,- ■ L v^+fe] ~ fjx^Xj^u . . . ^ j j 

Divided differences are usually computed by forming a triangular table. 







First 


Second 


Third 


X 




divided differences 


divided differences 


divided differences 


x 


/[so] 












f[xo,xi] 






X\ 


f[*l] 




f[x ,x 1 ,x 2 ] 








f[xi,x 2 ] 




f[x ,x 1 ,x 2 ,x 3 ] 


Xi 


f[x2] 




f[x 1 ,x 2 ,x 3 ] 








I[X2,X 3 ] 






X3 


/N 









8.1 .3.5 Newton's interpolatory divided-difference formula 

(also known as the Newton polynomial) 

n 

P n (x) = f[x ] + ^2 f[xo,xi,. . -,x k ](x - x ) ■ ■ ■ (x - X k -l). (8.1.18) 
k = \ 

Labeling the nodes as {x n ,x n -i, . . . ,xo}, aformula similar to Equation (8. 1.18) 
results in Newton's backward divided-difference formula, 

P n (x) = f[x n ] + f[x n ,x n -i](x - x n ) 

+ f[x 2 ](x - x n )(x ) (8.1.19) 

+ • • • + f[x n ,x n -i, ■ ■ -,x ](x - x n ) ■ ■ ■ (x - Xi). 

If the nodes are equally spaced (that is, X{ — X{-\ = h), de ne the parameter 
s by the equation x = xq + sh. The following formulae evaluate P n (x) at a single 
point: 

1 . Newton's interpolatory divided-difference formula, 

P n (x)=P n (x + sh) = J2(^jk\h k f[x ,x 1 ,...,x k }. (8.1.20) 
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2. Newton's forward-difference formula (Newton-Gregory), 



P n (x) = P n (x + sh) = Q A " fM- 
3. Newton-Gregory backward formula ( ts nodes x _ n to xq), 



(8.1.21) 



P n (x)=f(x )+ ( 1 A/(x_i)+ , 2 



8 f A A 2 /(x_ 2 ) + 



+ l' S + ^ A" /(*-,,)■ (8-1.22) 



4. Newton's backward-difference formula, 



(8.1.23) 



where S/ k f(x n ) is the A; th backward difference, de ne d for a sequence {p„}, 
by VPn = Pn — Pn-i for n > 1. Higher powers are de ned recursively by 
V k Pn = V(V* _1 Pn) for k > 2. For notation, set V°Pn = Pn- 

5. Stirling's formula (for equally spaced nodes X- m , X-\, xq, x\, . . . , x m ), 

sh 

P n (x) = P 2m+1 (x) = f[x ] + —(f[x-i,x ] +/[x ,xi]) + 

s 2 h 2 f[x- 1 ,x ,x 1 ] -\ (/[x_ 2 ,a;_i,xo,xi] + f[x- 1 ,x ,x 1 ,x 2 ]) 

+ ... + s 2 (s 2 - l)(s 2 - 4) • • • (s 2 - (m - l) 2 )h 2m f[x- m , ...,x m ] 
s(s 2 - 1) ■ ■ ■ (s 2 - m 2 )h 2m+1 



+ 



-(f[x- m -l,. ■ ■ ,X m ] + f[x. 



■mi ■ ■ ■ i 



X m +l])- 



Use the entire formula if n = 2m + 1 is odd, and omit the last term if n = 2m 
is even. The following table identi es the desired divided differences used in 
Stirling's formula: 







First divided 


Second divided 


Third divided 


X 


/(*) 


differences 


differences 


differences 


X-2 


f[X-2] 


/[x_2,X_i] 






X-i 


f[x-i] 


f[x-i,x ] 


/[x_ 2 ,x_i,x ] 


f[X- 2 ,X-i,X ,Xi] 


x 


f[xo] 


f[xo,xi] 


f[x- 1 ,x ,x 1 ] 


f[X-i,X ,Xi,X 2 ] 


X\ 


f[*l] 


f[xi,x 2 ] 


f[x ,x 1 ,x 2 ] 




X2 
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8.1.3.6 Inverse interpolation 

Any method of interpolation which does not require the nodes to be equally spaced 
may be applied by interchanging the nodes (x values) and the function values (y 
values). 



8.1.3.7 Hermite interpolation 

Given distinct numbers {xq,xi, . . . ,x n }, the Hermite interpolating polynomial for 
a function / is the unique polynomial H(x) of degree at most 2n + 1 that satis es 
H(xi) = f{xi) and H'(xi) = f'(xi) for each i = 0, 1, . . . ,n. 

A technique and formula similar to Equation (8.1.18) can be used. For distinct 
nodes {x ,x 1 , ... ,x n }, dene {z , zi, . . . , z 2n +i} by z 2i = z 2i+ i = xi for i = 
0,1, ... ,n. Construct a divided difference table for the ordered pairs (z^, f(zi)) 
using f'(xi) in place of / [z 2 i , z 2 j+i ] , which would be unde ned. Denote the Hermite 
polynomial by H 2n +i(x). 



8.1.3.8 Hermite interpolating polynomial 



2n+l 



H 2n+ i(x) = f[z ] + ^2 f[ z o,z\,. . . , z k ](x - z ) ■ ■ ■ (x - z k -i) 

= f[zo] + f[zo,zi]{x - x ) + f[z ,z 1 ,z 2 ](x - x ) 2 ^ j 24 ^ 

+ f[z ,z 1 ,z 2 ,z 3 ](x - x ) 2 (x - £1) 

+ • • • + /[ZO, ■ ■ -,Z2n+l](x ~ X ) 2 ■ ■ ■ (X - X n -!) 2 (X - X n ). 



THEOREM 8.1.7 (Error formula) 
Iff G C 2n+2 [a,b], then 

f{x) = H 2n+1 (x) + J — ( x ~ ^o) 2 ■■■(x- x n ) 2 (8.1.25) 

(in + 2)1 

for some ^(x) € (a, b) and where Xi € [a, b]for each i = 0,1, . . . ,n. 



8.1 .4 FITTING EQUATIONS TO DATA 
8.1.4.1 Piecewise polynomial approximation 

An interpolating polynomial has large degree and tends to oscillate greatly for large 
data sets. Piecewise polynomial approximation divides the interval into a collec- 
tion of subintervals and constructs an approximating polynomial on each subinter- 
val. Piecewise linear interpolation consists of simply joining the data points with 
line segments. This collection is continuous but not differentiable at the node points. 
Hermite polynomials would require derivative values. Cubic spline interpolation is 
popular since no derivative information is needed. 
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DEFINITION 8.1.5 

Given a function f de ned on [a, b] and a set of numbers a = Xq < X\ < ... < 
x„ = b, a cubic spline interpolant, S,for f is a function that satis es 

1. S is a piecewise cubic polynomial, denoted Sj, on [xj, Xj+i] for each j = 
0,1,. 



2. 


S(xj) = f(xj) for each j = 0, 1, . . . , n. 




3. 


S j+1 (x j+1 ) = Sj(x j+ i) for each j = 0,1,.. 


. ,n - 2. 


4. 


S' j+1 (x j+1 ) = S'j(x j+i) for each j = 0, 1, . . 


. , n - 2. 


5. 


S" +1 (x j+1 ) = S'j (xj+i) for each j = 0, 1, . 


. . , n - 2. 


6. 


One of the following sets of boundary conditions is satis ed: 



(a) S"(xo) = S"(x n ) = (free or natural boundary), 

(b) S'(xo) = f'(xo) and S'(x n ) = f'(x n ) (clamped boundary). 

If a function / is de ne d at all node points, then / has a unique natural spline 
interpolant. If, in addition, / is differentiable at a and b, then / has a unique clamped 
spline interpolant. To construct a cubic spline, set 

Sj(x) = aj + bj(x - Xj) + Cj(x - Xj) 2 + dj(x - Xj) 3 

for each j = 0,l,...,n — 1. The constants {cij,bj,Cj, dj} are found by solving a 
tridiagonal system of linear equations, which is included in the following algorithms. 

8.1.4.2 Algorithm for natural cubic splines 

INPUT: n, {x$, x\ , • • • , x n }, 

ao = /(a;o),ai = f(xi), . . . , a n = f(x n ). 
OUTPUT: {a,j, bj, Cj, dj} for j = 0, 1, . . . ,n - 1. 
Algorithm: 

1. For i = 0,1, ... ,n — 1, set hi = Xi+i — xi. 

2. Fori = 1, 2, . . . , n — 1, set on = — (<Zj+i — a«) — (a, — a,_i). 

hi hi-\ 

3. Set £ = 1,(10 = 0, zo = 0. 

4. Fori = 1,2, . . . ,n - 1, 

setii = 2(x i+1 - Xi-i) - hi-ipi-i; 

set pi = hi jli ; 

set Zi = (ai - hi-iZi-i) I ti. 

5. Set l n = 1, z n = 0, c n = 0. 

6. For j = n — l,n — 2, . . . , 0, 

setcj = Zj -pjc j+1 ; 

set bj = (a j+1 - cij)/hj - hj(c j+1 + 2 Cj )/3; 
set dj = (cj+i - Cj)/(3hj). 

7. OUTPUT (aj,bj,Cj,dj for j = 0, 1, . . . , n - 1). STOP 
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8.1 .4.3 Algorithm for clamped cubic splines 

INPUT: n, {xq, x\ , . . . , x n }, 

ao = f(xo), ai = f(xi), a n = f(x n ), 

F = f'(xo),F n = f(x n ). 
OUTPUT: {aj,bj,Cj,dj} for j = 0, 1, . . . , n - 1. 
Algorithm 

1. For i = 0,1, ... ,n — 1, set hi = xi+\ — xi. 

2. Seta = 3(ai -a )/h -3F ,a n = 3F n - 3(a„ - a n _i)//i n _i. 

3 3 

3. Fori = 1,2, ... ,n-l, seta, = — (a i+1 - a*)-- (a,-a,_i). 

4. Set £ = 2/i , /io = 0.5, 2; = a /4- 

5. Fori = 1,2, . . . ,n — 1, 

set£, = 2(x i+ i - Xi-i) - 
set /ij = hi/li, 
set 2;, = (a, - 

6. Set£„ = /i„_i(2 - /i„_i), z„ = (a„ - h n -iz n -i) / t n , c n = z n . 

7. For j = n — 1, n — 2, . . . , 0, 

setcj = *j -fijCj+u 

set 6j = (aj+i - aj)//ij - hj(c j+1 + 2c,)/3; 
setdj = (cj+i - Cj)/(3hj). 

8. OUTPUT {a,j,bj,Cj,dj for j = 0, 1, . . . , n - 1). STOP 



8.1.4.4 Discrete approximation 

Another approach to t a function to a set of data points {(xj,2/j)|i = l,2,...,m} 
is approximation. If a polynomial of degree n is used, the polynomial P n (x) = 
Y^l=o a kX k is found that minimizes the least-squares error E = ^™ 1 [y,— P n (xi)] 2 . 

To nd {ao, ai , . . . , a„}, solve the linear system, called the normal equations, 
created by setting partial derivatives of E taken with respect to each a u equal to zero. 
The coef cien t of ao in the rst equation is actually the number of data points, m. 



8.1.4.5 Normal equations 

m m m mm 

ao £ X i + Gl £ X i + ° 2 £ X i + ■ ■ ■ + fl " £ X i = £ 2/ iX i ' 

i — l i — l i—l i — l i—l 

m m m mm 

a ^ + aj ^ x\ + a 2 ^ x? + . . . + a„ ^ x™ +1 = ^ y t x\, y 2 ^ 

i—l i — l i—l i—l i—l 

m m m mm 

ao 5>" + °i £ *? + 1 + «2 £ 2 + ■ ■ ■ + a„ ^ x* n = ViX n i- 

i — l i — l i—l i—l i—l 
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Note: P n (x) can be replaced by a function / of speci ed form. Unfortunately, to 
minimize E, the resulting system is generally not linear. Although these systems can 
be solved, one technique is to "linearize" the data. For example, if y = f(x) = be ax , 
then In y = In 6 + ax. The method applied to the data points (xi,\nyi) produces 
a linear system. Note that this technique does not nd the approximation for the 
original problem but, instead, minimizes the least-squares for the "linearized" data. 



8.1.4.6 Best-t line 

Given the points Pi = (xi,yi), P 2 = (^2,2/2), P n = (x n ,y n ), the line of 
best- 1 is given by y — y = m(x — x) where 



1 " 

- V Xi 

n ^ 



(xi+x 2 + ■■■+ x n ) 



y = ±Yy i= (l/l+Ift + ---+I/n) (8.1.27) 

i=l 

(x 1 y 1 + x 2 y2 + ■ ■ ■ + x n y n ) - nx y xy-xy 



m 



{x\ + x\ + . . . + x 2 n ) - nx 2 x 2 - x 



■2 



8.2 NUMERICAL LINEAR ALGEBRA 



8.2.1 SOLVING LINEAR SYSTEMS 

The solution of systems of linear equations using Gaussian elimination with back- 
ward substitution is described in Section 8.2.2. The algorithm is highly sensitive 
to round-off error. Pivoting strategies can reduce round-off error when solving an 
n x n system. For a linear system Ax = b, assume that the equivalent matrix equa- 
tion A^x = b^*' has been constructed. Call the entry, < me pivot element. 



8.2.2 GAUSSIAN ELIMINATION 

To solve the system Ax = b, Gaussian elimination creates the augmented matrix 

an ■ ■ ■ ai n bi 



A' = [A : b] 



a n i 



b n 



(8.2.1) 



This matrix is turned into an upper-triangular matrix by a sequence of (1) row per- 
mutations, and (2) subtracting a multiple of one row from another. The result is a 
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matrix of the form (the primes denote that the quantities have been modi ed) 

a' n a' 12 
a' 22 . . 

_ ... 

This matrix represents a linear system that is equivalent to the original system. If 
the solution exists and is unique, then back substitution can be used to successively 
determine {x n ,x n -\ ,...}. 



2 2n 



(8.2.2) 



8.2.3 GAUSSIAN ELIMINATION ALGORITHM 

INPUT: number of unknowns and equations n, matrix A, and vector b. 
OUTPUT: solution x = (x\ , . . . , x n ) J to the linear system Ax = b, 

or message that the system does not have a unique solution. 
Algorithm: 

1. Construct the augmented matrix A 1 = [A : b] = (aj ■) 

2. For i = 1, 2, . . . , n — 1 do (a)-(c): (Elimination process) 

(a) Let p be the least integer with i <p <n and a' pi ^ 

If no integer can be found, then 
OUTPUT("no unique solution exists"). STOP. 

(b) If p ^ i interchange rows p and i in A 1 . Call the new matrix A' . 

(c) For j = i + 1, . . . , n do i-ii: 

i. Set my = a'jja'a. 

ii. Subtract from row j the quantity (m^ times row i). 
Replace row j with this result. 

3. If a' nn = then OUTPUT ("no unique solution exists"). STOP. 

4. Seta;„ = a' n n+ i/a' nn - (Start backward substitution). 

5. Fori = n-l,...,2,lsetXi = [a' in+1 - £"=i+i a'^x^ /a' u . 

6. OUTPUT (x\ , . . . , x„), (Procedure completed successfully). STOP. 



8.2.4 PIVOTING 

8.2.4.1 Maximal column pivoting 

Maximal column pivoting (often called partial pivoting) nds, at each step, the ele- 
ment in the same column as the pivot element that lies on or below the main diagonal 
having the largest magnitude and moves it to the pivot position. Determine the least 



p> k such that 



,(*) 

l pk 



niaxKKn 



a; 



(k) 



and interchange the k lh equation with the 



p lh equation before performing the elimination step. 
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8.2.4.2 Scaled-column pivoting 

Scaled-column pivoting sometimes produces better results, especially when the el- 
ements of A differ greatly in magnitude. The desired pivot element is chosen to 
have the largest magnitude relative to the other values in its row. For each row 
dene a scale factor by s, = maxi<j<„ |ciy|. The desired pivot element at 



the k step is determined by choosing the smallest integer p with 



,(*) 

l pk 



maxfc<j<„ 



,(*) 



hi 



8.2.4.3 Maximal (or complete) pivoting 

The desired pivot element at the k th step is the entry of largest magnitude among 
{fly} with i = k, k + 1, . . . , n and j = k, k + 1, . . . , n. Both row and column 
interchanges are necessary and additional comparisons are required, resulting in ad- 
ditional execution time. 



8.2.5 EIGENVALUE COMPUTATION 
8.2.5.1 Power method 

Assume that the n x n matrix A has n eigenvalues {Ai , A2 , . . . , A„} with linearly 
independent eigenvectors {y^\y^ 2 \ . . . , v^™' } . Assume further that A has a unique 
dominant eigenvalue A 1, that is |Ai| > | A2 1 > | A3 1 > ••• > |A„|. Note that for any 
xeffi n ,x=^ 1 a i v«. 

The algorithm is called the power method because powers of the input matrix 
are taken: lim^_ i . 00 A k x = lim^_ i . 00 X k ai\^\ However, this sequence converges to 
zero if |Ai | < 1 and diverges if |Ai | > 1, provided a.\ ^ 0. Appropriate scaling of 
A k x is necessary to obtain a meaningful limit. Begin by choosing a unit vector x (°) 
having a component x $ such that x$ = 1 = || . 

The algorithm inductively constructs sequences of vectors {x ( m ' }„= and 
{y^ m ')m=o anc * a sequence of scalars {p^}™^ by 

y(m) =i4x (m-l) i /i (m) =2/ (m^ ! x (m) = ( g 2 . 3 ) 

vZ 



(m) 

VpJ 



(m) 



where, at each step, p m represents the least integer for which 
The sequence of scalars satis es lim m _>. 00 

H im) = Ai, provided a.\ ^ 0, and 
the sequence of vectors {x( m )}$^L converges to an eigenvector associated with Ai 
that has l^ norm one. 

8.2.5.2 Power method algorithm 

INPUT: dimension n, matrix A, vector x, tolerance TOL, and 

maximum number of iterations N. 
OUTPUT: approximate eigenvalue [i, 

approximate eigenvector x (with ||x|| = 1), 
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or a message that the maximum number of 
iterations was exceeded. 
Algorithm: 

1. Setfc=l. 

2. Find the smallest integerp with 1 < p < n and \x p \ = HxH^. 

3. Set x = x/xp. 

4. While (k < N) do (a)-(g): 

(a) Set y = Ax. 

(b) Set (j, = y p . 

(c) Find the smallest integer p with 1 < p < n and \y p \ = WyW^. 

(d) If y p = then OUTPUT ("Eigenvector", x, "corresponds to 
eigenvalue 0. Select a new vector x and restart."); STOP. 

(e) Set ERR = ||x - y/ypW^; x = y/y p . 

(f) If ERR < TOL then OUTPUT (p, x) 

(procedure successful) STOP. 

(g) Setfc = k + 1. 

5. OUTPUT ("Maximum number of iterations exceeded"). STOP. 



Notes: 

1 . The method does not really require that A i be unique. If the multiplicity is 
greater than one, the eigenvector obtained depends on the choice of x (°) . 

2. The sequence constructed converges linearly, so that Aitken's A 2 method 
(Equation (8.1.1)) can be applied to accelerate convergence. 



8.2.5.3 Inverse power method 

The inverse power method modi es the power method to yield faster convergence 
by nding the eigenvalue of A that is closest to a speci ed number q. Assume that 
A satis es the conditions as before. If q ^ A,, for i = 1, 2, . . . , n, the eigenvalues 
of (A-ql) -1 are j^j, • • • j \ _ g » with m e same eigenvectors . . . , v^. 

Apply the power method to (A - ql) _1 . At each step, y( m ' = (A - V m_1 ) . 
Generally, y( m ) is found by solving (A — ql)y^ m ' > = x( m_1 ) using Gaussian elimi- 
nation with pivoting. Choose the value q from an initial approximation to the eigen- 
vector x(°) by q = x(°) T Ax(°) / (x^V )) . 

The only changes in the algorithm for the power method (see page 742) are to 
set an initial value q as described (do this prior to step 1), determine y in step (4a) 
by solving the linear system (A — ql)y = x (if the system does not have a unique 
solution, output a message that q is an eigenvalue and stop), delete step (4d), and 
replace step (4f) with 

if ERR < TOL then set /i = - + q; OUTPUT^, x) ; STOP. 
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8.2.5.4 Wielandt de ation 

Once the dominant eigenvalue has been found, remaining eigenvalues can be found 
by using de a tion techniques. A new matrix B is formed having the same eigenval- 
ues as A, except that the dominant eigenvalue of A is replaced by 0. One method is 
Wielandt de alio n which de nes x = - [an a^ ... aj n ] T , where is a coor- 
dinate of that is non-zero, and the values {an , a,2 , ■ • • , ctm} are the entries in the 
i th row of A. Then the matrix B = A — AivWx T has eigenvalues 0, A2, A3, . . . , A„ 
with associated eigenvectors -{V 1 ', w^ 2 ', w^ 3 ', . . . , w( n )}, where 



for i = 2, 3, . . . , n. The i th row of B consists entirely of zero entries and B may 
be replaced with an (n — 1) x (n — 1) matrix B' obtained by deleting the i th row 
and i th column of B. The power method can be applied to B' to nd its dominant 
eigenvalue and so on. 



8.2.6 HOUSEHOLDER'S METHOD 
DEFINITION 8.2.1 

Two n x n matrices A and B are said to be similar if a non-singular matrix S exists 
with A = S~ 1 BS. (Note that if A is similar to B, then they have the same set of 
eigenvalues.) 

Householder's method constructs a symmetric tridiagonal matrix B that is sim- 
ilar to a given symmetric matrix A. After applying this method, the QR algorithm 
can be used ef ciently to approximate the eigenvalues of the resulting symmetric 
tridiagonal matrix. 

8.2.6.1 Algorithm for Householder's method 

To construct a symmetric tridiagonal matrix A^ n ~ 1 ' ) similar to the symmetric matrix 
A = A^, construct matrices A^, A^, . . . , A^K where A^ = (a^) fork = 
1,2,. 

INPUT: dimension n, matrix A. 

OUTPUT: . (At each step, A can be overwritten.) 

Algorithm: 

1. For k = 1, 2, . . . , n - 2 do (a)-(k). 



V W = (Aj - Ai)w« + Ai(x T w«)v (1) 



(8.2.4) 




(k) 

■k+l,k ■ 



(c) Set RSQ = a 2 - aa 



© 2003 by CRC Press LLC 



(d) Setvk = 0. (Note: v\ = ■ ■ ■ = vu-i = 0, but are not needed.) 

(k) 

for j = k + 2, . . . , n set «j = a^- 1 . 

(e) Forj = fc,fc + l,...,nsetuj = ( ELa+i 4*^0 / RS Q- 

(f) Set PROD = Er=t+i«i«i- 

(g) For j = fc, k + 1, . . . , n set ^ = uj - (PROD/2 RSQ>j. 

(h) For I = k + 1, k + 2, . . . , n - 1 do i-ii. 

i. For j = £ + 1, . . . ,n set = - i;^- - VjZf, 

Jk+i) _ Jk+i) 
a ej - a je . 

ii. Set <4* +1 ^ = — Ivizg. 

C\ C t (*+!) — (*) _ 9 

(j) For j = k + 2, . . . , n set ajj.* +1) = a^ +1) = 0. 

W ael a A+i,A - a k+i,k v k+iZk, a k k+1 — a k+l k . 

(Note: The other elements of A( k+1 *> are the same as .) 

2. OUTPUT^™" 1 )). STOP. 

(^4(n-i) j s symmetric, tridiagonal, and similar to A.) 



8.2.7 QR ALGORITHM 

The QR algorithm is generally used (instead of de ation) to determine all of the 
eigenvalues of a symmetric matrix. The matrix must be symmetric and tridiagonal. 
If necessary, rst apply Householder's method. Suppose the matrix A has the form 



ai 


b- 2 


• 











b 2 




63 














h 


as 




















a n -2 


b n -l 














b n -l 


dn-1 


b n 








• 





b n 





If b 2 = or b n = 0, then A has the eigenvalue a\ or a n , respectively. If bj = for 
some j,2 < j < n, the problem is reduced to considering the smaller matrices 



b 2 




b 2 
(12 b 3 
h a 3 








bj- 



and 



aj 


bj+i 








i+i 


a j+ i 


bj+2 








bj+2 


a j+ 2 













a n -i b„ 










bn &n 
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If no bj equals zero, the algorithm constructs A^ 2 \ A^ z \ ... as follows: 

1. A (1 1 = A is factored as A (1 1 = Q^rW, with Q (1 1 orthogonal and i?« 
upper-triangular. 

2. AW isdened as A^ = rWqW. 

In general, A (i+1 1 = R^Q^ = (QW T AW)QW = Q (i ^A ( ^Q (i K Each 
^(t+i) j s S y mme tric and tridiagonal with the same eigenvalues as A^ and, hence, 
has the same eigenvalues as A. 



8.2.7.1 Algorithm for QR 

To obtain eigenvalues of the symmetric, tridiagonal n x n matrix 



A = A 1 







(!) „W 1,(1) 



(,(1) „(1) 



a 



a 3 











2 (1) 
' t n-2 

l(1) 
>n-\ 









°n-l 
"n-l 
" n 





J 1 ) 



(8.2.7) 



(i) 



}, tolerance TOL, and 



INPUT: n; {a\ 

maximum number of iterations M. 
OUTPUT: eigenvalues of A, or recommended splitting of A, 

or a message that the maximum number of iterations was exceeded. 
Algorithm: 

1. Set k = 1; SHIFT = 0. (Accumulated shift) 

2. While k < M, do steps 3-12. 

3. Test for success: 
{k) < TOL, then set A 
OUTPUT (A); setn = n 



(a) If 

(b) If 



a (k) + SHIFT; 
1. 



,(*) 



< TOL then set A = a\ h) + SHIFT; 



OUTPUT (A); 

i (*) 
set n = n — 1; a\ 



, (*) 
n set dj ' 



fox j = 2 

(c) If n = then STOP. 

(d) If n = 1 then set A = a[ k) + SHIFT: 

OUTPUT(A); STOP. 

(e) Forj = 3,...,n-l 



if 



■,(*) 



< TOL then 



OUTPUT ("split into", {a[ k) ,..., a>*\ , b\ K> b y *\ }, 
"and" {a (k) ,...,a (k) , b^% ,...,b (k) }, SHIFT) ; STOP. 



>.(*) 
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-(ai k l 1+ ai%c: 



(k) (k) 

&n 0> n — l 



[b ( n k) ] 2 ;d= (6 2 -4c)i 



4. Compute shift: 
Set 6 

5. If 6 > 0, then set /ij = -2c/(b + d); ii 2 = -(b + d)/2; 

else set /ii = (d — b) /2; /x 2 = 2c/ (d—b). 

6. If n = 2, then set Ai = fn + SHIFT; A 2 = Hi + SHIFT; 

OUTPUT (Ai,A 2 ); STOP. 



7. Choose s so that 



,(*) 



lin ^ 



mm I Lui 



,(*) 



(*) 



)- 



8. Accumulate shift: Set SHIFT = SHIFT + s. 

9. Perform shift: For j = 1, . . . , n set dj = a^p — s. 
10. Compute B.W : 

(a) Set xi = d\\yi = 6 2 . 

(b) Forj = 2,...,n 

set Zj -i = {x]_ x + [bf ) ] 2 )5; Cj = Xj-i/zj-i, 
set S j = bf ] I Zj -u qj -i = Cjyj-! + Sjdj- 



set xj = —SjUj-i +cjdj. 



»,(*) • 



If j ^ n then set r^-i = Sjb^^yj - 

(At this point, = PjA^ k } 1 has been computed (Pj is a rotation 
matrix) and RW = A ( „ ] .) 
11. Compute A (k+1 K 



(k+i) 



s 2 qi + c 2 zi, 6 2 ' 



(a) Set2;„ = x n ; a\ 

(b) Forj = 2,3..., n - 1, 

seta) i '/.; + 'j'j • i -j" 

set b 

(c) Seta^ +1 



(k+i) 



S2Z2- 



j+1 ~ a 3 + i*31 



12. Set k = k + 1. 

13. OUTPUT ("Maximum number of iterations exceeded"); 

(Procedure unsuccessful.) STOP. 
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8.2.8 NON-LINEAR SYSTEMS AND NUMERICAL OPTIMIZATION 



8.2.8.1 Newton's method 

Many iterative methods exist for solving systems of non-linear equations. Newton's 
method is a natural extension from solving a single equation in one variable. Con- 
vergence is generally quadratic but usually requires an initial approximation that 
is near the true solution. Assume F(x) = where x is an n-dimensional vector, 
F : M™ ->• IK™, and is the zero vector. That is, 

F(x) = F(xi,x 2) . . . ,x„) = [f 1 (x 1 ,x 2 ,...,x n ),...,f n (x 1 ,x 2 ,...,x n )] T . 

(8.2.8) 

A x ed-point iteration is performed on G(x) = x — ( J(x)) _1 F(x) where J(x) 
is the Jacobian matrix, 





9/i(x) 


9/i(x)"| 


dx i 
8 Si (x) 


8X2 
9/2 (x) 


dx „ 
9/2 (x) 


dx i 


8X2 


dx n 


9/„(x) 


9/„(x) 


9/„(x) 


- dx i 


8X2 


dx n - 



J(x) 



The iteration is given by 



(8.2.9) 



(8.2.10) 



The algorithm avoids calculating ( J(x)) 1 at each step. Instead, it nds a vector 
y so that J(x(*" 1 ))y = -F^*" 1 )), and then sets x^ = x^" 1 ) + y. 

For the special case of a two-dimensional system (the equations f(x, y) = and 
g(x, y) = are to be satis ed), Newton's iteration becomes: 



Vn+1 = Vn 



f9y ~ fv9 



fx9y fy9x 
fx9 - f9x 
fx9y ~ fy9x 



(8.2.11) 



x = x„,y=y 



8.2.8.2 Method of steepest-descent 

The method of steepest-descent determines the local minimum for a function of the 
form g : IK™ — > IK. It can also be used to solve a system {/,} of non-linear equations. 
The system has a solution x = (x\ , x 2 , ■ ■ ■ , x n ) J when the function 

n 

g(x 1 ,x 2 ,- ..,x n ) = ^[/,(a;i,a;2, • • • ,x n )] 2 (8.2.12) 

has the minimal value zero. 

This method converges only linearly to the solution but it usually converges 
even for poor initial approximations. It can be used to locate initial approximations 
that are close enough so that Newton's method will converge. Intuitively, a local 
minimum for a function g : E™ — > E can be found as follows: 
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1. Evaluate g at an initial approximation x(°) = (xf , ■ ■ ■ , Xn ) T . 

2. Determine a direction from x^ ' that results in a decrease in the value of g. 

3. Move an appropriate distance in this direction and call the new vector x ^ . 

4. Repeat steps 1 through 3 with x(°) replaced by x^K 

The direction of greatest decrease in the value of g at x is the direction given by 
— Vgf(x) where V<?(x) is the gradient of g. 

DEFINITION 8.2.2 

If g : IK™ — > IK, the gradient ofgatx = {x\ , x-i , . . . , x n ) T , denoted Vg(x), is 



Vg(x) = 




(8.2.13) 



Thus, set xW = x(°) — aV<?(x(°)) for some constant a > 0. Ideally the value 
of a minimizes the function h(a) = g(x^ — aV<?(x(°))) . Instead of tedious di- 
rect calculation, the method interpolates h with a quadratic polynomial using nodes 
ai , Q2, and (*3 that are hopefully close to the minimum value of h. 

8.2.8.3 Algorithm for steepest-descent 

To approximate a solution to the minimization problem min g(x), given an initial 
approximation x. 

INPUT: number n of variables, initial approximation x = (x \ , X2 , ■ ■ ■ , x n ) T , 
tolerance TOL, and maximum number of iterations N. 

OUTPUT: approximate solution x = (x \ , X2 , ■ ■ ■ , x n ) T 
or a message of failure. 

Algorithm: 

1. Set k = 1. 

2. While (k < N), do steps (a)-(k). 

(a) Set: gi = g(x u . . . ,x„); (Note: gi = g(x^).) 

z = Vg(xi,. . . ,x„); (Note: z = Vj(xW).) 
zo = ||z|| 2 - 

(b) Uz o = then OUTPUT ("Zero gradient"); 

OUTPUT (xi, . . . ,x n ,gi); 

(Procedure completed, may have a minimum.) STOP. 

(c) Set z = z/zo- (Make z a unit vector.) 

Set ai = 0; a 3 = 1; g 3 = g(x - a 3 z). 

(d) While ((73 > <?i), do steps i-ii. 

i. Set a 3 = a 3 /2; g 3 = g(x - a 3 z). 

ii. If a 3 < TOL/2,then 

OUTPUT ("No likely improvement"); 
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OUTPUT (x 1 ,...,x n ,g 1 ); 

(Procedure completed, may have a minimum.) 

STOP. 



(e) Set a 2 = a 3 /2; g 2 = g(x - a 2 z). 

(f) Set: hi = (g 2 - gi)/a 2 ; h 2 = (g 3 - g 2 )/(a 3 - a 2 ); 

h 3 = (h 2 - hi)/a 3 . 

(g) Set: ceo = (&2 — h\/h 3 )/2 (critical point occurs atao-) 

9o = 5( x - "oz)- 

(h) Find a from {ao, a 3 } so that g = g(x — az) = minjgo, g 3 }- 

(i) Set x = x — az. 

(j) If Iff " 9i I < TOL then OUTPUT (x u ...,x n , g); 

(Procedure completed successfully.) STOP, 
(k) Set k = k + 1. 

3. OUTPUT ("Maximum iterations exceeded"); 
(Procedure unsuccessful.) STOP. 



Numerical quadrature involves estimating J f(x) dx using a formula of the form 



8.3.1.1 Newton-Cotes formulae 

A closed Newton-Cotes formula uses nodes x,: = xq + ih for i = 0, 1, . . . , n, where 
h = (b — a) fn. Note that xo = a and x„ = b. 

An open Newton-Cotes formula uses nodes x ,: = xo + ih for i = 0, 1, . . . , n, 
where h = (b — a)/(n + 2). Here xo = a + h and x„ = b — h. Set x_i = a and 
x„ + i = b. The nodes actually used lie in the open interval (a, b). 

In all formulae, £ is a number for which a < £ < b and fi denotes /(x,). 

8.3.1.2 Closed Newton-Cotes formulae 

1. (n = 1) Trapezoidal rule 



8.3 NUMERICAL INTEGRATION AND 
DIFFERENTIATION 



8.3.1 NUMERICAL INTEGRATION 




(8.3.1) 
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2. (n = 2) Simpson's rule 

rb 



J f(x)dx = ^[f( Xo )+4f( Xl )+f(x 2 )} - ^/ ( %)- 



3. (n = 3) Simpson's three-eighths rule 



/ O/j QUO 
f(x) dx = -U(x ) + 3f( Xl ) + 3f(x 2 ) + f(x 3 )} - ^/ ( %)- 



4. (n = 4) Milne's rule (also called Boole's rule) 

rb 



/ 1h Rh^ 
f(x) dx = — [7/ + 32/i + 12/ 2 + 32/ 3 + 7/ 4 ] - ^/ (6) (6- 



/ (6) (^). 



5. (n = 5) 

/' 6 S/) 27 c 5/) 7 

= --[19/0 + 75/1+50/2+50/3 + 75/4 + 19/5]-^^ 

6. (n = 6) Weddle's rule 

/ f{x) dx = lio [41/o + 216/1 + 27/2 + 272/3 + 27/4 + 216/5 + 41/e] 

9/49 / (8) (6- 



1400 
7. (n = 7) 

f 6 7h 

J fix) dx = T ^[751/o+3577/ 1 +1323/ 2 +2989/ 3 +2989/4+1323/ 5 



8.3.1.3 Open Newton-Cotes formulae 

1 . (n = 0) Midpoint rule 



j\x)dx = 2hf(x ) + ^-f "(0- 



2. (n = 1) 

/ 6 "\h 3/) 3 

/(*) dx = Y [f(x ) + f( Xl )} + — /"(£). 



© 2003 by CRC Press LLC 



3. (n = 2) 

rb 



J f(x) dx = y [2/(30) " f( Xl ) + 2f(x 2 )} + ^f (4) (0- 

4. (n = 3) 

f(x) dx = -[Uf(x ) + f( Xl ) + f(x 2 ) + Uf(x 3 )} + W / (4) (6- 

5. (n = 4) 

J' /(*) dx = ^[ll/o - 14/! + 26/ 2 - 14/ 3 + HA] + ^f i6 HO- 



6. (n = 5) 

f 6 



r 7/) 

J f{x) dx = 1440 [611/o " 453/1 + 562/2 + 562/3 " 453/4 + 6U/s] 



8640 J SJ 



8.3.1.4 Composite rules 

Some Newton-Cotes fonnulae extend to composite formulae. This consists of divid- 
ing the interval into subintervals and using Newton-Cotes formulae on each subin- 
terval. In the following, note that a < fi <b. 

1 . Composite trapezoidal rule for n subintervals: If / € C 2 [a,b],h = (b — a)/n, 
and xj = a + jh, for j = 0, 1, . . . , n, then 

rb u , "- 1 



f b h r 

/ f(x)dx=-\f(a)+2Y,f(x j ) + f(b) 

Ja * . =1 



b - a u2t»f ^ 



3= 

2. Composite Simpson's rule for n subintervals: If / € C 4 [a, b] , n is even, h 
(b — a)/n, and xj = a + jh, for j = 0, 1, . . . , n, then 



f b , («/2)-l n/2 

/ f{x)dx = -\f{a)+2 f(x 2j )+4j2f(x 2j -i)+f(b)] 
■'■ ' i=i i=i 



3. Composite midpoint rule for n + 2 subintervals: If / € C 2 [a,6],n is even, 
h = (b — a)l(n + 2), and Xj = a + (j + l)h, for j = — 1, 0, 1, . . . , n + 1, then 



r 6 ™ /2 - 

/ /(*)<& = 2/^/0^) + — -h 2 f"(jx). 

Ja i= „ 
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8.3.1.5 Romberg integration 

Romberg integration uses the composite trapezoidal rule beginning with h i = b — 
a and hk = (b - a)/2 k ~ 1 , for A; = 1,2, . . ., to give preliminary estimates for 
f(x) dx and improves these estimates using Richardson's extrapolation. Since 
many function evaluations would be repeated, the rst column of the extrapolation 
table (with entries denoted Rij) can be more ef ciently determined by the following 
recursion formula: 



Ri,i = y [/(«) + /(&)] = ^[/(«) + /(&)], 



Rk,i 



1 



R k - 1A + h k -i J2 /(« + ( 2 * " !)^*) 



(8.3.2) 



for k = 2, 3, ... . Now apply Equation (8.1.4) to complete the extrapolation table. 

8.3.1.6 Gregory's formula 

Using fj to represent f(xo + jh), 



rxo+nh -i -i 

/ f(y) dy = h(-f + fi + ... + /„_! + -/„) 

Jxq 

+ A(A/ - A/„_!) - A(A 2 /o + A 2 /„- 2 ) 
+ ^(A 3 /o - A 3 /„- 3 ) - ^(A 4 /o + A 4 /„- 4 ) + • • • (8.3.3) 

where A's represent forward differences. The rst expression on the right in Equa- 
tion (8.3.3) is the composite trapezoidal rule, and additional terms provide improved 
approximations. Care must be taken not to carry this process too far because Gre- 
gory's formula is only asymptotically convergent in general and round-off error can 
be signi cant when computing higher differences. 
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FIGURE 8.2 

Formulae for integration rules with various weight functions 



Weight 

w(x) 



Interval 

(a,/3) 



Abcissas 
are zeros of 



1 



(-1,1) 



Pn(x) 



See table on page 755 



(n + l)P n+1 (xi)PUxi) 



2 2 " +1 (n!) 4 
(2n+l)[(2w)!l 3 



(0,oo) 



L n (x) 



See table on page 756 



(n\) 2 Xi 



(n+l) 2 L 2 +1 (^) 



Ml 
(2n)! 



(— oo, oo) 



H n (x) 



See table on page 756 



2 n " 1 n!0F 



n\\pK 
2"(2n)! 



VI - a; 2 



(-1,1) 



T„(a;) 



(2i - 1)tt 
2n 



77 

n 



2tt 



2 2 "(2n)! 



(-1,1) 



Un(x) 



n + 1 



n ■ 2 
■ sin 



n + 1 



n + 1 



2 2 "+!(2n)! 



1 — x 



(0,1) 



t2n+l 



(^) 



(2i - 1)tt 
4n + 2 



2tt 



2n + 1 



(2i - 1)tt 
4n + 2 



2 4 "+!(2n)! 



1 -a; 
1 +x 



(0,1) 



J„ a;, 



1 1 

2'~2 



2in 
2n + 1 



47T . 2 

■ sin 



2n + l 



2n + l 



2 2 "(2n) 



1 

•Jx 



(0,1) 



P2n(y/x~) 



{4f 



2hi 



2 4n+1 [(2n)!] 3 
(4n+ l)[(4n)!1 2 



Jx 



(0,1) 



2n+l 



(v^) 



•Jx 



my 



2hi (xf) 



2 4n+3 [(2n + l)!] 4 
(4n + 3)[(4n + 2)!] 2 (2n)! 



In this table, P n ,L n , H n , T n ,U n , and J n denote the n th Legendre, Laguerre, Hermite, Chebyshev ( rst kind T n , second 
kind U n ), and Jacobi polynomials, respectively. Also, xf denotes the i th positive root of P2n(a?) or P2n+i(a?) of the 
previous column, and hi denotes the corresponding weight for xf in the Gauss-Legendre formula (w(x) = 1). 



© 2003 by CRC Press LLC 



8.3.1.7 Gaussian quadrature 

A quadrature formula, whose nodes (abscissae) x^ and coef cients w, are chosen 
to achieve a maximum order of accuracy, is called a Gaussian quadrature formula. 
The integrand usually involves a weight function w. An integral in t on an interval 
(a, b) must be converted into an integral in x over the interval (a, (3) speci ed for 
the weight function involved. This can be accomplished by the transformation x = 



(ba-ai3) + (0-a)t 



(b- 



(b- 



Gaussian quadrature formulae generally take the form 



/ W (x) f (x) dx = ^ w i f ( x i ) + E n 

J a : 



(8.3.4) 



where E n = K n f( 2n ) (£) for some a < £ < ft and K n is a speci ed constant. Many 
popular weight functions and their associated intervals are summarized in the table 
on page 754. 

The following tables give abscissae and weights for selected formulae. If some 
Xi are speci ed (such as one or both end points), then the formulae of Radau and 
Lobatto may be used. 



8.3.1 .8 Gauss-Legendre quadrature 

Weight function is w (x) = 1. 



n 


Nodes {±X{} 


Weights {wi} 


2 


0.5773502692 


1 


3 





0.8888888889 




0.7745966692 


0.5555555556 


4 


0.3399810436 


0.6521451549 




0.8611363116 


0.3478548451 


5 





0.5688888889 




0.5384693101 


0.4786286705 




0.9061798459 


0.2369268851 


6 


0.2386191861 


0.4679139346 




0.6612093865 


0.3607615730 




0.9324695142 


0.1713244924 


7 





0.4179591837 




0.4058451514 


0.3818300505 




0.7415311856 


0.2797053915 




0.9491079123 


0.1294849662 



/l n 
f{x) dx PS ~Y^Wif{Xi) 

_1 i=l 



n 


Nodes {±a;,} 


Weights {wi} 


8 


0.1834346425 





3626837834 




0.5255324099 





3137066459 




0.7966664774 





2223810345 




0.9602898565 





1012285363 


9 








3302393550 




0.3242534234 





3123470770 




0.6133714327 





2606106964 




0.8360311073 





1806481607 




0.9681602395 





0812743883 


10 


0.1488743390 





2955242247 




0.4333953941 





2692667193 




0.6794095683 





2190863625 




0.8650633667 





1494513492 




0.9739065285 





0666713443 
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8.3.1 .9 Gauss-Lag uerre quadrature 

poo " 

Weight function is w (x) = e~ x . / e~ x f(x) dx £s ^ Wif(xi). 



n 


Nodes {a;,} 


Weights {w{\ 


2 





5857864376 





8535533905 




3 


4142135623 





1464466094 


3 





4157745567 





7110930099 




2 


2942803602 





2785177335 




6 


2899450829 





0103892565 


4 





3225476896 





6031541043 




1 


7457611011 





3574186924 




4 


5366202969 





0388879085 




9 


3950709123 





0005392947 


5 





2635603197 





5217556105 




1 


4134030591 





3986668110 




3 


5964257710 





0759424496 




7 


0858100058 





0036117586 




12 


6408008442 





0000233699 



n 


Nodes {xi} 


Weights {wi} 


6 





2228466041 





4589646739 




1 


1889321016 





4170008307 




2 


9927363260 





1133733820 




5 


7751435691 





0103991974 




9 


8374674183 





0002610172 




15 


9828739806 





0000008985 


7 





1930436765 





4093189517 




1 


0266648953 





4218312778 




2 


5678767449 





1471263486 




4 


9003530845 





0206335144 




8 


1821534445 





0010740101 




12 


7341802917 





0000158654 




19 


3957278622 





0000000317 



8.3.1 .10 Gauss-Hermite quadrature 

/oo 2 n 

e~ x f(x) dx pa Wjf(xj). 
-CO 



i=l 



n 


Nodes {±Xi} 


Weights {wi} 


2 


0.7071067811 


0.8862269254 


3 





1.1816359006 




1.2247448713 


0.2954089751 


4 


0.5246476232 


0.8049140900 




1.6506801238 


0.0813128354 


5 





0.9453087204 




0.9585724646 


0.3936193231 




2.0201828704 


0.0199532420 


6 


0.4360774119 


0.7246295952 




1.3358490740 


0.1570673203 




2.3506049736 


0.0045300099 



n 


Nodes {±a;,} 


Weights {wi} 


7 










8102646175 







8162878828 





4256072526 




1 


6735516287 





0545155828 




2 


6519613568 





0009717812 


8 





3811869902 





6611470125 




1 


1571937124 





2078023258 




1 


9816567566 





0170779830 




2 


9306374202 





0001996040 


9 










7202352156 







7235510187 





4326515590 




1 


4685532892 





0884745273 




2 


2665805845 





0049436242 




3 


1909932017 





0000396069 
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8.3.1 .1 1 Radau quadrature 



i2n-lr 



i(n-l)!] 4 



f(x) dx = Wl f(-1) + Y l *>if(*i) + * [(2n t -l)!p ^ f (2n ~ L) ^ 
where each free node x; is the i th root of p *>-i( x )+ p *>( x ) an( j w . — Lz*i 



i=2 



x + 1 



, n; see the following table. Note that x\ 



- 1 and w 



2/n 2 . 



for 



71 


Nodes 


\X7ip-i ctViI"*; ini- \ 


3 


-0.2898979485 


1.0249716523 




0.6898979485 


0.7528061254 


4 


-0.5753189235 


0.6576886399 




0.1810662711 


0.7763869376 








5 


-0.7204802713 


0.4462078021 




-0.1671808647 


0.6236530459 




0.4463139727 


0.5627120302 




0.8857916077 


0.2874271215 


6 


-0.8029298284 


0.3196407532 




-0.3909285467 


0.4853871884 




0.1240503795 


0.5209267831 




0.6039731642 


0.4169013343 




0.9203802858 


0.2015883852 


7 


-0.8538913426 


0.2392274892 




-0.5384677240 


0.3809498736 




-0.1173430375 


0.4471098290 




0.3260306194 


0.4247037790 




0.7038428006 


0.3182042314 




0.9413671456 


0.1489884711 



n 


Nodes 


Weights {wi} 


8 


-0.8874748789 





1853581548 




-0.6395186165 





3041306206 




-0.2947505657 





3765175453 




0.0943072526 


n 
u 


oyio / Z 10 / 4 




fl 4fiS49D' : ! 1: ;44 





3470147956 




0.7706418936 





2496479013 




0.9550412271 





1145088147 


9 


-0.9107320894 





1476540190 




-0.7112674859 





2471893782 




-0.4263504857 





3168437756 




-0.0903733696 





3482730027 




0.2561356708 





3376939669 




0.5713830412 





2863866963 




0.8173527842 





2005532980 




0.9644401697 





0907145049 


10 


-0.9274843742 





1202966705 




-0.7638420424 





2042701318 




-0.5256460303 





2681948378 




-0.2362344693 





3058592877 




0.0760591978 





3135824572 




0.3806648401 





2906101648 




0.6477666876 





2391934317 




0.8512252205 





1643760127 




0.9711751807 





0736170054 



/: 



8.3.1.12 Lobatto quadrature 

f(x)dx = w 1 f(-l)+w n f(l) 

+ T v, f (x ) - n(n-lf2^[(n-2W (a „_ a) ( ) 
+ 2L,w,nx>) (2n-l)[(2n-2)!]3 1 UJ 

where x t is the (i - l) st root of P^ix) and = „ ( „_ 1)[ p n _ i(a .. )] 2 for i = 
2, ... ,n — 1. Note that x\ = — 1, x n = 1, andwi = w n = 2/(n(n — 1)). The table 
lists all Xi and w, for n < 13. 
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n 


Nodes {±a;,} 


Weights {w{\ 


3 







1 


3333333333 




1 







3333333333 


4 





4472135954 





8333333333 




1 







1666666666 


5 










7111111111 







6546536707 





5444444444 




1 







1000000000 


6 





2852315164 





5548583770 







7650553239 





3784749562 




1 







0666666666 


7 










4876190476 







4688487934 





4317453812 







8302238962 





2768260473 




1 







0476190476 


8 





2092992179 





4124587946 







5917001814 





3411226924 







8717401485 





2107042271 




1 







0357142857 


9 










3715192743 







3631174638 





3464285109 







6771862795 





2745387125 







8997579954 





1654953615 




1 







0277777777 



n 


Nodes {±Xi} 


Weights {w{\ 


10 


0.1652789576 





3275397611 




0.4779249498 





2920426836 




0.7387738651 





2248893420 




0.9195339081 





1333059908 




1 





0222222222 


11 








3002175954 




0.2957581355 





2868791247 




0.5652353269 





2480481042 




0.7844834736 





1871698817 




0.9340014304 





1096122732 




1 





0181818181 


12 


0.1365529328 





2714052409 




0.3995309409 





2512756031 




0.6328761530 





2125084177 




0.8192793216 





1579747055 




0.9448992722 





0916845174 




1 





0151515151 


13 








2519308493 




0.2492869301 





2440157903 




0.4829098210 





2207677935 




0.6861884690 





1836468652 




0.8463475646 





1349819266 




0.9533098466 





0778016867 




1 





0128205128 



8.3.1 .13 Chebyshev quadrature 



f(x) dx K, - 
i n 



n 


Nodes {±a;,} 




n 


Nodes {±a;,} 


2 


0.5773502691 




5 













0.3745414095 


3 









0.8324974870 




0.7071067811 














6 


0.2666354015 


4 


0.1875924740 






0.4225186537 




0.7946544722 






0.8662468181 



Nodes {±a;,} 





0.3239118105 
0.5296567752 
0.8838617007 
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8.3.1.14 Multiple integrals 

Quadrature methods can be extended to multiple integrals. The general idea, using 
a double integral as an example, involves writing the double integral in the form of 
an iterated integral, applying the quadrature method to the "inner integral" and then 
applying the method to the "outer integral". 



8.3.1.15 Simpson's double integral over a rectangle 

To integrate a function f(x, y) over the rectangular region R = {(x, y) \ a < x < 
b,c < y < d} using the composite Simpson's Rule produces an approximating 
formula given below. Intervals [a, b] and [c, d] must be partitioned using even integers 
n and to to identify evenly-spaced mesh points xq, x\ , . . . , x n and yo,Vi, - ■ ■ , Vm, 
respectively. 



f(x,y)dydx 



f(x,y)dydx 



hk 



i=0 j=0 



where the error term E is given by 

(d-c)(b-a) 



E 



180 



(8.3.5) 



(8.3.6) 



for some (r?,/i) and (fj,fi) in R with h and k determined by h = (b — a)/n and 
k = (d — c)/m, and the coef cients Cjj are the entries in the following table. 



TO 




1 


4 


2 


4 


2 


4 .. 


2 


4 


1 


TO — 


1 


4 


16 


8 


16 


8 


16 .. 


8 


16 


4 


TO — 


2 


2 


8 


4 


8 


4 


8 .. 


4 


8 


2 


TO — 


3 


4 


16 


8 


16 


8 


16 .. 


8 


16 


4 


2 




2 


8 


4 


8 


4 


8 .. 


4 


8 


2 


1 




4 


16 


8 


16 


8 


16 .. 


8 


16 


4 







1 


4 


2 


4 


2 


4 .. 


2 


4 


1 


3 
























i 





1 


2 


3 


4 


5 .. 


. n-2 


n — 1 


n 



Similarly, Simpson's Rule can be extended for regions that are not rectangular. 
It is simpler to give the following algorithm than to state a general formula. 



8.3.1.16 Simpson's double integral algorithm 

To approximate the integral I = / / f(x,y)dydx: 

J a J c(x) 

INPUT endpoints a, b; even positive integers to, n; 

functions c(x), d(x), and f(x, y) 
OUTPUT approximation J to I. 
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Algorithm: 

1. Set h = (b - a) /n; Ji = 0; (End terms.) 

J 2 =0; (Even terms.) J 3 =0. (Odd terms.) 

2. Fori = 0,l,...,ndo(a)-(d). 

(a) Set x = a + ih; 

(Composite Simpson's method for x.) 
HX = (d(x) - c(x))/m; 
K\ = f(x,c(x)) + f(x, d(x)); (End terms.) 
K 2 = 0; (Even terms.) 
K 3 = 0. (Odd terms.) 

(b) For j = 1, 2, m — 1 do i-ii. 

i. Set y = c(x) + jHX; Q = f(x, y). 

ii. If j is even then set K 2 = K 2 + Q else set K 3 = K 3 +Q. 

(c) Set L = {K 1 + 2K 2 + 4K 3 )HX/3. 



Jc(xi) 

(d) If i = or i = n then set Ji = Ji + L; 

else if i is even then set J 2 = J 2 + L; 
else set J 3 = J 3 + L. 

3. Set J = h{ Ji + 2J 2 + 4J 3 )/3. 

4. OUTPUT(J); 
STOP. 

8.3.1.17 Gaussian double integral 



forming, for each x in [a, b], the interval [c(a;), d(x)] to [—1, 1] and then applying 
Gaussian quadrature. This is performed in the following algorithm. 

8.3.1 .18 Gauss-Legendre double integral 



To approximate the integral I = / / f(x,y)dydx: 



INPUT endpoints a, b; positive integers to, n. 

(The roots r,j and coef cien ts c,j are found in 8.3.1.8 for 

i = max{TO, n) and for 1 < j < i.) 
OUTPUT approximation J to I. 
Algorithm: 

1. Set/u = (b-a)/2; h 2 = (b + a)/2; J = 0. 

2. For i = 1,2, to do (a)— (c). 
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f{x,y)dydx rst requires trans- 



(a) Set JX = 0; 

x = hir m ,i + h 2 ; 

d\ = d(x); c\ = c(x); 

ki = (di - ci)/2; k 2 = {di + ci)/2. 

(b) For j = 1,2, ...,ndo 

sety = far n>j +k 2 ; 

Q = f(x,v); 

JX = JX + c n>j Q. 

(c) Set J = J + c m4 kiJX. 

3. Set J = hi J. 

4. OUTPUT(J); STOP. 

8.3.1.19 Double integrals of polynomials over polygons 

If the vertices of the polygon A are {(a:i,yi), {x%,y%), ... , (x p ,y p )}, and we de ne 
Wi = x { y i+1 - x i+1 yi (with x p+1 = x 1 and y p+1 = yj) then 

y y x m y n dA= 

mini ^ ( j + k\ (m + n — j 

(m + n + 2)l^ Wi ^ o ^ o { j ){ n-k 

8.3.1.20 Monte-Carlo methods 

Monte-Carlo methods, in general, involve the generation of random numbers (ac- 
tually pseudorandom when computer-generated) to represent independent, uniform 
random variables over [0,1]. Section 7.6 describes random number generation. Such 
a simulation can provide insight into the solutions of very complex problems. 

Monte-Carlo methods are generally not competitive with other numerical meth- 
ods of this section. However, if the function fails to have continuous derivatives 
of moderate order, those methods may not be applicable. One advantage of Monte- 
Carlo methods is that they extend to multidimensional integrals quite easily, although 
here only a few techniques for one-dimensional integrals / = g(x) dx are given. 

8.3.1 .21 Hit or miss method 

Suppose < g(x) < c, a < x < b, and fl = {(x,y) \ a < x < b, < y < c}. If 
(X, Y) is a random vector which is uniformly distributed over fl, then the probability 
p that (X, Y) lies in S (see Figure 8.3) is p = I/(c(b — a)). 

If TV independent random vectors {(Xi, li)li=i are generated, the parameter p 
can be estimated by p = Nh /N where Nh is the number of times Y{ < g(Xi), i = 
1,2, ... ,N, called the number of hits. (Likewise TV — Nh is the number of misses.) 
The value of / is then estimated by the unbiased estimator Q\ = c(b — o)Nh /N. 



(8.3.7) 



X; 



Xi+lSJi 
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FIGURE 8.3 

Illustration of the Monte-Carlo method. The sample points are shown as circles. The solid 
circle is counted as a "hit", the empty circle is counted as a "miss". 




8.3.1 .22 Hit or miss algorithm 

1. Generate {Uj} 2 ^ of 27V random numbers, uniformly distributed in [0, 1). 

2. Arrange the sequence into N pairs (Ui ,U[), (U%, U^), . . . , (Un,U' n ), so that 
each Uj is used exactly once. 

3. Compute Xj = a + Ui(b — a) and g{Xi) for i = 1, 2, . . . , N. 

4. Count the number of cases Njj for which g(X{) > cU-. 

5. Compute 0\ = c(b — o)Nh /N . (This is an estimate of /.) 



The number of trials TV necessary for P(\6i — I\ < e) > a is given by 

(1 - p)p[c(b - a)} 2 



N > 



(1 - a)e 2 



(8.3.8) 



With the usual notation of z a for the value of the standard normal random vari- 
able Z for which P(Z > z a ) = a (see page 695), a con d ence interval for / with 
con de nee level 1 — a is 



VgCj -P)(b - a)c 



(8.3.9) 



8.3.1.23 Sample-mean Monte-Carlo method 

Write the integral / = g(x) dx as j^j^jfx(x) dx, where / is any probability 



s(x) 

fx(X) 



density function for which fx{x) > when g(x) ^ 0. Then I = E [ 

where the random variable X is distributed according to fx(x). Values from this 
distribution can be generated by the methods discussed in Section 7.6.2. For the case 
where fx(x) is the uniform distribution on [0, 1], I = (b — a)E[g(X)]. An unbiased 
estimator of / is its sample mean 



1 N 

e S = (b-a)-^g(X i ) 



(8.3.10) 



© 2003 by CRC Press LLC 



It follows that the variance of # 2 is less than or equal to the variance of Q\. In 



fact, 



var#i = — [c(b - a) - I], 



vartf 2 = - 



r b 

(b-a) / g 2 (x)dx-I 2 

J a 



(8.3.11) 



Note that to estimate / with 6\ or # 2 , g(x) is not needed explicitly. It is only 
necessary to evaluate g(x) at any point x. 



8.3.1.24 Sample-mean algorithm 

1. Generate {U^f^ of N random numbers, uniformly distributed in [0, 1). 

2. Compute X t = a + Ut(b - a), for i = 1, 2, . . . , N. 

3. Compute g(Xt) for i = 1, 2, . . . , N. 

4. Compute 9 2 according to Equation (8.3.10). (This is an estimate of I.) 



8.3.1.25 Integration in the presence of noise 

Suppose g(x) is measured with some error: g(xi) = g{xi) + e,, fori = 1,2, ... ,N, 
where e, are independent identically distributed random variables with E[e,] = 0, 
var(e,) = a 2 , and |e,| < k < 00. 

If (X,Y) is uniformly distributed on the rectangle a<x<6,0<j/<ci, 
where c\ > g(x) + k, set 6\ = c\(b — o)Nh/N as in the hit or miss method. 
Similarly, set §2 = jj(b — a) J2iLi 9(X%) as in the sample-mean method. Then both 
61 and 62 are unbiased and converge almost surely to /. Again, var 62 < var 6\ . 

8.3.1.26 Weighted Monte-Carlo integration 

Estimate the integral I = g(x) dx according to the following algorithm: 

1. Generate numbers {U\, U2, . . . , Un} from the uniform distribution on [0, 1). 

2. Arrange U\, U2, Un in the increasing order C/(i), C/( 2 ), U^y 

N 



3. Compute 63 = ^ 



^2(g( u (i)) + g(U(i+ri)(U(i+i) - U(i)) 



i=0 



, where [/( ) 



0, C^(at+i) = 1. This is an estimate of I. 



If g(x) has a continuous second derivative on [0, 1], then the estimator 63 satis- 
es var 63 = E [(#3 — I) 2 ] < k/N 4 , where k is some positive constant. 
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8.3.2 NUMERICAL DIFFERENTIATION 
8.3.2.1 Derivative estimates 

Selected formulae to estimate the derivative of a function at a single point, with error 
terms, are given. Nodes are equally spaced with Xi — Xi-\ = h; h may be positive 
or negative and, in the error formulae, £ lies between the smallest and largest nodes. 
To shorten some of the formulae, fj is used to denote f(xo + jh) and some error 
formulae are expressed as 0(h k ). 

1 . Two-point formula for / ' (xq ) 



This is called the forward-difference formula if h > and the backward- 
difference formula if h < 0. 

2. Three-point formulae for f'(xo) 



f(x ) = ^(f(x + h)-f(x ))-^f(0- 



(8.3.12) 



f(x ) = ^[-3f(x )+4f(x + h) 
= ^r[f(xo + h)-f(x -h)] 




(8.3.13) 



3. Four-point formula (or ve uniformly spaced points) for f'(xo) 



(8.3.14) 



4. Five-point formula for / ' (xq ) 



f(x ) = T^[-25/o + 48/! - 36/ 2 + 16/ 3 - 3/ 4 ] + y/ (5) (£)- (8.3.15) 



5. Formulae for the second derivative 



/"M = ^[/-i-2/ + /i]-^/ (4) (a 

= 4[/o - 2h + h] + ^/ (4) (6) - /*/ (3) (6). 



(8.3.16) 



6. Formulae for the third derivative 



f^Hxo) = ^[h - 3/ 2 + 3/x - /o] + O(ft) 

= ^3 If* ~ 2 /i + 2 /-i - /-a] + °( /i2 )- 



(8.3.17) 
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7. Formulae for the fourth derivative 

/ (4) (*o) = ^[h - 4/ 3 + 6/ 2 - 4/i + f ] + 0(h) 



1 



(8.3.18) 



[h ~ 4/i + 6/0 - 4/_x + /_ 2 ] + 0(/j 2 ). 



Richardson's extrapolation can be applied to improve estimates. The error term 
of the formula must satisfy Equation (8.1.2) and an extrapolation procedure must be 
developed. As a special case, however, Equation (8.1.4) may be used when rst- 
column entries are generated by Equation (8.3.13). 



8.3.2.2 Computational molecules 

A computational molecule is a graphical depiction of an approximate partial deriva- 
tive formula. The following computational molecules are for h = Ax = Ay: 



du 
ox 



(b) £ 

dy 



t,3 



t,3 



— (« ,i -«o,-i) +0 (h 2 ) 



1 

2h 




> +0(h 2 ) 



(c) — 



(d) 



*,3 



— (uifl - 2u ,o + U-1,0) + O (h 2 ) 



,}+0(h 2 ) 



dx dy 



1 

4h? 



("1,1 - "1,-1 - "-1,1 + "-l.-l) + O (h 2 ) 

r 

0^ K ^ 2 ) 




(e) V 2 "| = ("1,0 + "o,i + "-1.0 + uo,-i - 4uoo) + O (h 2 ) 




> + O (h 2 ) 



© 2003 by CRC Press LLC 



8.3.2.3 Numerical solution of differential equations 

Numerical methods to solve differential equations depend on whether small changes 
in the statement of the problem cause small changes in the solution. 



DEFINITION 8.3.1 

The initial-value problem, 

^=f(t,y), a<t<b, y(a)=a, (8.3.19) 

is said to be well posed if 

1. A unique solution, y(t), to the problem exists. 

2. For any e > 0, there exists a positive constant k(e) with the property that, 
whenever |e | < e and S(t) is continuous with \S(t)\ < e on [a,b], a unique 
solution, z(t), to the problem, 

dz 

— = f(t,z) + S(t), a<t<b, z(a) = a + e , 
exists and sais es \z(t) — y(t)\ < k(e)e, for all a < t < b. 



This is called the perturbed problem associated with the original problem. Al- 
though other criteria exist, the following result gives conditions that are easy to check 
to guarantee that a problem is well posed. 

THEOREM 8.3.1 (Well posed condition) 

Suppose that f and f y ( its r st partial derivative with respect toy) are continuous for 
t in [a, b]. Then the initial-value problem given by Equation (8.3.19) is well posed. 

Using Taylor's theorem, numerical methods for solving the well posed, rst- 
order differential equation given by Equation (8.3. 19) can be derived. Using equally- 
spaced mesh points ti = a + ih (for i = 0,1,2, ... ,N) and w, to denote an approx- 
imation to yi = y(ti), then methods generally use difference equations of the form 

w = a, w i+1 = Wi + h<f>(ti,Wi), 

for each i = 0,1,2, ... ,N — 1. Here <j> is a function depending on /. The difference 
method has local truncation error given by 

T i+ i(h) = Vl+1 h - ~ </>(ti,Vi), 

for each i = 0,1,2, ... ,N — 1. The following formulae are called Taylor methods. 
Each has local truncation error 

un f,n 

for each i = 0, 1, 2, . . . , N - 1, where & G (U,t i+1 ). Thus, if y e C n+1 [a,b] the 
local truncation error is 0(h n ). 
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1. Euler's method (n = 1): 

w i+1 =Wi + hf(ti,Wi). 

2. Taylor method of order n: 

w i+ i =Wi + hT (n Hti,Wi), 



(8.3.20) 



(8.3.21) 



where T<») (U, Wi ) = f(U, Wi ) + */'(*<, + . . . + 

The Runge-Kutta methods below are derived from the n th degree Taylor poly- 
nomial in two variables. 



3. Midpoint method: 

Wi+i = Wi + h[f (U + %,Wi + £/(*,, Wi))] 



(8.3.22) 



If all second-order partial derivatives of / are bounded, this method has local 
truncation error 0(h 2 ), as do the following two methods. 

4. Modi ed Euler method: 

Wi+i =Wi + \ {f(ti,Wi) + f[t i+ i,Wi + hf(U,Wi)]} . (8.3.23) 



5. Heun's method: 



W i+ i =Wi + 



{/(*<> 



Wi) + 3/ 



2 2 
U + -^h,Wi + -hf(ti,Wi) 



6. Runge-Kutta method of order four: 



w i+ i = Wi + \{ki + 2k- 2 + 2k 3 + k 4 ), 
6 



(8.3.24) 



where 



h = hf(U,Wi) , 

ki = hf (ti + ^,Wi + ^k^j , 

kz = hf (ti + ^,Wi + ^k 2 ^j , 
k 4 = hf(t i+1 ,Wi + k 3 ) . 

The local truncation error is 0(h 4 ) if the solution y(t) has ve continuous 
derivatives. 



8.3.2.4 Multistep methods and predictor-corrector methods 

A multistep method is a technique whose difference equation to compute in- 
volves more prior values than just w,. An explicit method is one in which the com- 
putation of Wj+i does not depend on , whereas an implicit method does 
involve , For each formula, i = n — 1, n, . . . , N — 1. 
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8.3.2.5 Adams-Bashforth n-step (explicit) methods 

1. (n = 2): 

w = a,w 1 = ai, w i+1 =Wj + §[3/(i,, w,) - f(U-i , Wj_i)]. 
Local truncation error is r,-|_i(/i) = j^y^ (pi)h 2 , for some pi € 

2. (n = 3): 

w = a,Wi = ai,w 2 =a2,Wj+i = Wj + ^[23/(^,Wj)-16/(i;_i, w,_i) + 
5/(^-2,^-2)]. 

Local truncation error is t, + i (K) = |?/ 4 )(/ij)/j 3 , for some /x, € (ij_2,i«+i). 

3. (n = 4): 

w = a, wi = ai, w 2 = a 2 , w 3 = a 3 , w i+1 = w, + £[55f(U, w,) - 

59/(^_i, Wj_i) + 37/(^_2, Wj_ 2 ) -9/(^-3,^-3)]. 

Local truncation error is Tj+i(/i) = ||^y( 5 '(/i,)/i 4 , for some /x, € (i«-3, i»+i). 

4. (n = 5): 

WO = W\ = di, H)2 = ^2:^3 = a 3 , W4 = d!4, Wj_|_l = Wj + 

4[1901/(^, - 2774/(t i _ 1 , w^) + 2616/(^-2, Wi _ 2 ) 

-1274/(^-3, Wi-g) +251/(^-4,^^4)]. 

Local truncation error is Tj+i(/i) = -^y^ (fii)h 5 , for some /i, € (ij_4,ij+i). 

8.3.2.6 Adams-Moulton n-step (implicit) methods 

1. (n = 2): 

w = a,w 1 = ai,w,+i = w, + j|[5/(ij + i, w i+1 )+8f(U, w,)-/(i,_i , w,_i)]. 
Local truncation error is n+i(h) = — ^j?/ 4 ' (/i,)/i 3 , for some /x, € (ij_i , ij+i). 

2. (n = 3): 

w = a,wi = ai,w 2 = a 2 , w,+i = w, + ^[9/(* i+ i , w i+1 ) + 19f(U, w,) - 
5/(^_i, Wj_i) + /(ij_2,w,_ 2 )]. 

Local truncation error is n+i (h) = —^y^ (fJ-i)h 4 , 

for some m e (^_ 2 ,^+i). 

3. (n = 4): 

w = a, wi = ai, w 2 = a 2 , w 3 = a 3) w,+i = w, + ^[251/(^+1, w i+ i) + 
646/(t i ,u; i ) - 264/(i i _ 1 ,w»_ 1 ) + 106/(t,_ 2 , w»_ 2 ) - 19/(^-3^-3)]. 

Local truncation error is n+i (h) = — j^y^ {jii)h h , 

for some m e (ti- 3 ,t i+1 ). 

In practice, implicit methods are not used by themselves. They are used to 
improve approximations obtained by explicit methods. An explicit method predicts 
an approximation and the implicit method corrects this prediction. The combination 
is called a predictor-corrector method. For example, the Adams-Bashforth method 
with n = 4 might be used with the Adams-Moulton method with n = 3 since both 
have comparable errors. Initial values may be computed, say, by the Runge-Kutta 
method of order four, Equation (8.3.24). 
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8.3.2.7 Higher-order differential equations and systems 

A system of m rst-ord er initial-value problems can be expressed in the form 



~~dt 

du 2 



fi(t,ui,u 2 , ■ ■ ■ ,u m ), ui(a)=oti, 



/ 2 (t,Mi,«2,...,u m ), u 2 {a)=a 2 , 
dt (8.3.25) 



<JUr 



dt 



f m (t,ui,u 2 ,...,u m ), u m (a) = a, 



Generalizations of methods for solving rst-order equations can be used to solve 
such systems. An example here uses the Runge-Kutta method of order four. 

Partition [a, b] as before, and let Wij denote the approximation to Ui(tj) for 
j = 0, 1, . . . , N and i = 1, 2, . . . , m. For the initial conditions, set wi i0 = a\, 
w 2 ,o = ct 2 , w m fi = a m . From the values {wij, w 2 j, Wm,j} previously 
computed, obtain {w\j+i, W2J+1, w m j+i} from 

ki,i = hfi (t j ,w 1 j,w 2 ,j, ■ ■ - ,w m j) , 

, , ( h 1, 1, 1, \ 

k-iA = hfi \tj + 2> w i.i + 2 W2J + 2 ' 2 ' ' ' ' ,Wm ' j + 2 ' m ) ' 

= hfi (tj + 7},Wl,j + ^k 2 ,l,W 2 ,j + ^2,2, ■ • -,W m ,j + ^ fc 2,mj , 

h,i = hfi (tj + h,w 1 j + fc 3 ,i,W2,j + h,2, ■ ■ - ,w m j + k Zt m) , 
w u+1 = iv i j + i [k hi + 2fc 2j! : + 2k 3:i + k 4 ,i] , (8.3.26) 

where i = 1, 2, . . . , m for each of the above. 

A differential equation of high order can be converted into a system of rst-ord er 
equations. Suppose that a single differential equation has the form 

V (m) = f(t,y,y',y",...,y^), a<t<b (8.3.27) 

with initial conditions y (a) = a\,y'{a) = a 2 , . . . , y( m_1 ) (a) = a m . All derivatives 
are with respect to t. That is, j/W = De ne m(t) = y(t), u 2 (t) = y'(t), 
u m {t) = y^ m ~ l \t). This yields rst-ord er equations 

dui du 2 du m -i du m 

d ' "' ( (8.3.28) 

with initial conditions u\{a) = ot\, u m (a) = a m . 
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8.3.2.8 Partial differential equations 

To develop difference equations for partial differential equations, one needs to esti- 
mate the partial derivatives of a function, say, u(x,y). For example, 

d^ y) = u( X + h,y^-u( X ,y) _h3M^ for ^ ( ^ + /i)) (83 . 29) 

d 2 u 1 h 2 d i u(£,y) 

gS(x,y) = j^[u(x + h,y) - 2u(x,y) + u(x - h,y)] - — — — , (8.3.30) 

for £ £ (x — h, x + h). 

Notes: 



1. Equation (8.3.29) is simply Equation (8.3.12) applied to estimate the partial 
derivative. It is given here to emphasize its application for forming differ- 
ence equations for partial differential equations. A similar formula applies for 
du/dy, and others could follow from the formulae in Section 8.3.2.1. 

2. An estimate of d 2 u/dy 2 is similar. A formula for d 2 u/dxdy could be given. 
However, in practice, a change of variables is generally used to eliminate this 
mixed second partial derivative from the problem. 



If a partial differential equation involves partial derivatives with respect to only 
one of the variables, the methods described for ordinary differential equations can 
be used. If, however, the equation involves partial derivatives with respect to both 
variables, the approximation of the partial derivatives requires increments in both 
variables. The corresponding difference equations form a system of linear equations 
that must be solved. 

Three speci c forms of partial differential equations with popular methods of 
solution are given. The domains are assumed to be rectangular. Otherwise, additional 
considerations must be made for the boundary conditions. 

8.3.2.9 Poisson equation 

The Poisson equation is an elliptic partial differential equation that has the form 

d 2 u d 2 u 
V 2 u{x,y) = g^(x,y) + -^{x,y) = f(x,y) (8.3.31) 

for (x,y) G R = {(x,y) \ a<x<b,c<y<d}, with u(x,y) = g(x,y) for 
(x,y) G S, where S = dR. When the function f(x,y) = the equation is called 
Laplace's equation. 

To begin, partition [a, b] and [c, d\ by choosing integers n and m, de ne step 
sizes h = (b — a)/n and k = (d — c) /m, and set Xi = a + ih for i = 0, 1, . . . , n 
and yj = c + jk for j = 0, 1, . . . , m. The lines x = Xi,y = yj, are called grid lines 
and their intersections are called mesh points. Estimates Wij for u(xi,yj) can be 
generated using Equation (8.3.30) to estimate and The method described 
here is called the nite-d ifference method. 
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Start with the values 

woj = g(xo,Vj), w n ,j = g(x n ,Vj), Wi,o = g(xi,yo), Wi, m = g(xi,y m ), 

(8.3.32) 

and then solve the resulting system of linear algebraic equations 

(j^j (wij+i+Wij-i) = -h 2 f(xi,yj), 

(8.3.33) 

for i = 1, 2, . . . , n — 1 and j = 1, 2, . . . , m — 1. The local truncation error is 
0(h 2 +k 2 ). 

If the interior mesh points are labeled Pi = (xi,yj) and we = Wij where 
i = i + (m — 1 — j)(n — 1), for i = 1, 2, . . . , n — 1, and j = 1, 2, . . . , m — 1, then 
the two-dimensional array of values becomes a one-dimensional array. This results 
in a banded linear system. The case n = m = 4 yields £ = (n — l)(m — 1) = 9. 
Using the relabeled grid points, fi = f(Pe), the equations at the points P t are 



Pi 




4wi 


- W2 


— W4 


= W ,3+W 1A - 


h 2 h, 


P-2 


4w 2 


- w 3 


— W\ 


- w 5 


= w 2 ,4-h 2 f 2 , 




Pz 




4w 3 


- W2 


- w 6 


= W 4 ,3+W 3A - 


h 2 h, 


Pi 




- w 5 


— W\ 


— W-j 


= w ,2 -h 2 f 4 , 




P 5 


4w 5 - w 6 


— H)4 


- W 2 


- w s 


= 0~h 2 fc, 




P 6 




- w 5 


- w 3 


- Wg 


= W4,2~h 2 f 6 , 




P~ 




4W7 


- w s 


— W4 


= w ,i+ w i,o- 


h 2 fr, 


Ps 


4w s 


- Wg 


— W-j 


- w 5 


= w 2 ,o-h 2 f$, 




Ps 




4-Wg 


- w s 


- w 6 


= W 3 fi + W4,l - 


h 2 fg, 



where the right-hand sides of the equations are obtained from the boundary condi- 
tions. 

The following algorithm can be used to solve the Poisson equation. Note that, 
for simplicity, the algorithm incorporates an iterative procedure called Gauss-Seidel 
for solving linear systems. Instead, Gaussian elimination is recommended (because 
stability with respect or round-off errors is assured) when the order is small (say, 
less than 100). For large systems, the SOR (Successive Over-Relaxation) method 
is recommended. The Gauss-Seidel and SOR methods can be found in Burden and 
Faires. 




8.3.2.10 Poisson equation nite-diff erence algorithm 

To approximate the solution to the Poisson equation 

V 2 u{x,y) = Q^(x,y) + Q^(x,y) = f(x,y), 

for a < x < b and c < y < d, 

subject to u(x, y) = g(x, y) if x = a or x = b and c < y < d and u(x,y) = g(x, y) 
if y = c or y = d and a < x <b: 
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INPUT endpoints a, b, c, d; integers m > 3, n > 3; tolerance TOL; 

maximum number of iterations N. 
OUTPUT approximations w,j to u(xi, yj) for i = 1, . . . , n — 1 

and j = 1, . . . , m — 1 or a message that N was exceeded. 
Algorithm: 

1. Set h = (b — a) /n; k = (d — c) /to. 

2. For i = 1, . . . , n — 1 set Xi = a + ih. 

3. For j = 1, . . . , to — 1 set yj = c + jk. 

4. For i = 1, . . . , n — 1 

for j = 1, . . . , to — 1 set = 0. 

5. Set A = h 2 /k 2 \ /i = 2(1 + A); i = 1. 

6. While i < N do (a)-(i) 

(a) Set 

z = ( - ^/(^i , 2/m-i) + <?(a, 2/m-i) + Ai?(a;i , d) 

,m — 1 

NORM = |z - Wl, m -1 1 ! Wl,m-1 = -Z- 

(b) Fori = 2,...,n-2 

set 2; = ( - ti 2 f(xi,y m -i) + Xg(xi,d) + Wi- 1>m -i 

,m— 1 

if |wj, m _i - z| > NORM then set NORM = |wj, m _i - z 
set w,, m _i = z. 

(c) Set 2;= ( - ti 2 f{x n -i,y m -i) +g(b,y m - 1 ) + Xg(x n -i,d) 

+W„- 2 ,m— 1 

if |w„_i jm _i - z\ > NORM then set NORM = |w„_i jm _i - 
set w„_i jm _i = z. 

(d) For j = to — 2, . . . , 2 do i-iii. 

i. Set 2= ( - h 2 f(x 1 ,y j ) + g(a,yj) + Xw 1 j +1 + Xw 1 j- 1 

if \w hj -z\> NORM then set NORM = \w hj - z\; 
set w\j = z. 

ii. Fori = 2,. . . ,n — 2 

set z = (-^/(x^i/jO+Wj-ij + At^j+i 4-Wj+ij 

+Xwij-i)/fi; 
if (wjj - z| > NORM then set NORM = - z|; 
set = z. 

iii. Set z = {-h 2 f(x n -i, yj)+g(b, y j )+w n - 2 ,j+Xw n - 1 j +1 

+Xw n -ij-i)/fi; 
if |w„_ij -z\> NORM then set NORM = |w„_ij - z| 
set w n -\j = z. 

(e) Set z = ( - h 2 f{xi ,yi) + g(a, yi) + Xg{xi , c) + Awi, 2 

+W2,i)//i; 

if - z| > NORM then set NORM = |w M - z\; 
set wi t i = z. 
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(f) Fori = 2,. . . ,n - 2 

set z = ( - h 2 f(xi,yi) + Xg(xi,c) + + Aw, i2 

if -z| > NORM then set NORM = |w M -z|; 
set w^i = z. 

(g) Set 2;= (-/i 2 /(^n-i,yi)+5(^ ! ?7i)+A3(a;„_i,c)+w„_2,i 

+Aw„_i j2 )//i; 
if |w„_i,i - z| > NORM then set NORM = |w„_i,i - z|; 

Set Wn-i^ = z. 

(h) If NORM < TOL then do i-ii. 

i. Fori = 1,. . . ,n — 1 

for j = 1, . . . ,m - 1 OUTPUT^,, 

ii. STOR (Procedure successful.) 

(i) Set£ = £ + 1. 

7. OUTPUT(' Maximum number of iterations exceeded.'); 
(Procedure unsuccessful.) 
STOP. 



8.3.2.1 1 Heat or diffusion equation 

The heat, or diffusion, equation is a parabolic partial differential equation of the form 



du u 

— (x,t)=a 2 T —r(x,t), 0<x<£, t>0, 
at ox 1 



(8.3.35) 



where u(0, t) = = u(l, t) = 0, for t > 0, and u(x, 0) = f(x), for < x < I. An 
ef cient method for solving this type of equation is the Crank-Nicolson method. 

To apply the method, select an integer m > 0, set h = £/m, and select a time- 
step size k. Here Xi = ih, i = 0, . . . , m and tj = jk, j = 0, . . . . The difference 
equation is given by: 



W iJ+1 - Wi 



a 

T 



h 2 



+ 



h 2 



= 
(8.3.36) 



and has local truncation error 0(k 2 + h 2 ). The difference equations can be rep- 
resented in the matrix form Aw^ +1 ^ = Bw' J ' , for each j = 0,1,2,..., where 
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A = a 2 k/h 2 , = (wij,W2j, • • • , w m _ij) T , and the matrices A and B are 



A 



B 



(1 + A) 


— Aj 1 


U 


U 


U 


U 


-A/2 


(1 + A) 


-A/2 














-A/2 


(1 + A) 


-A/2 








o 


o 


-A/2 


Cl 4- A) 
V- 1 - ' A y 


o 


o 














(1 + A) 


-A/2 














-A/2 


(1 + A) 


'ft \\ 
(1 - AJ 


Aj 1 


n 
U 


U 


U 


U 


A/2 




A/2 


n 

U 


n 

U 


n 

U 





A/2 


(1-A) 


A/2 














A/2 


(1-A) 




















(1-A) 


A/2 














A/2 


(1-A) 



(8.3.37) 



8.3.2.12 Crank-Nicolson algorithm 

To approximate the solution to the parabolic partial differential equation 

— (x,t)-a 2 —^(x,t)=0, 0<x<£, 0<t<T, 
at ox 1 

subject to boundary conditions u(0, t) = u(£,t) = for < t < T, and the initial 
conditions u(x, 0) = f(x) for < x < I. 

INPUT endpoint I; maximum time T; constant a; 

integers m > 3; N > 1. 
OUTPUT approximations w,j to u(xt, tj) for i = 1, . . . , m — 1, and 

./ 1 v. 

Algorithm: 

1. Set h = ijm\ k = T/N; A = a 2 k/h 2 ; w m = 0. 

2. For i = 1, . . . , m — 1 set Wi = f(ih). 

3. Set£j = 1 + A; ui = -\/(2£ 1 ). 

4. Fori = 2,. . . ,m - 2 

set li = 1 + A + Au,_i /2; = -A/(2^). 

5. Set £ m _i = 1 + A + Au m _ 2 /2. 

6. Forj = l,...,iVdo(a)-(e). 

(a) Seti = jfc; z Y = [(1 - A)wi + \w 2 ] 

(b) For i = 2, . . . , m - 1 

set ;z, = [(1 - A)w, + + + Zi-i)} jli. 

(c) Set w m _i = 2; m _i. 

(d) For i = m — 2, . . . , 1 set = Zi — . 
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(e) OUTPUT^); (Note: t = tj.) 

Fori = 1, . . . ,m — 1 set x = ih; OUTPUT(a;, wi). 
(Note: Wi = w«j.) 

7. STOP. (Procedure completed.) 



8.3.2.13 Wave equation 

The wave equation is an example of a hyperbolic partial differential equation and has 
the form 

d 2 u d 2 u 

— (x,t)-a 2 — (x,t)=0, 0<x<£, t>0 (8.3.38) 
ut ox z 

(where a is a constant) subject to u(0,t) = u(£,t) = Ofori > 0, andw(a;, 0) = f(x) 
du 

and ~~q^( x i 0) = g( x ) for < x < £. 

Select an integer m > 0, time-step size k > 0, and using h = £/m, mesh 
points (xi,tj) are de ned by Xi = ih and tj = jk. Using w,j to represent an 
approximation of u(xi,tj) and A = ak/h, the difference equation becomes 

Wij+i = 2(1 - X 2 )wij +X 2 (w i+1 j +Wi-i,j) -Wij-i, 

with wq j = w m j = and w, j0 = f{xi), for i = 1, . . . , m — 1 and j = 1,2,.... 
Also needed is an estimate for w^i, for each i = 1, . . . , m — 1, which can be written 

A 2 A 2 
= (1 - X 2 ).f(xi) + y/(^+i) + y/(^-i) + M^)- 

The local truncation error of the method is 0(h 2 + k 2 ) but the method is ex- 
tremely accurate if the true solution is in nitely differentiable. For the method to be 
stable, it is necessary that A < 1. The following algorithm, applied with A < 1, is 
0(h 2 + k 2 ) convergent if / and g are suf ciently differentiable. 



8.3.2.14 Wave equation algorithm 

To approximate the solution to the wave equation 
d 2 u d 2 u 

— (x,t)-a 2 — (x,t)=0, 0<x<£, 0<t<T, 

subject to u(0, t) = u(£, t) = for < t < T, u(x, 0) = f(x) for < x < £, and 
du 

_(a;,0) = g(x) forO < x < £. 

INPUT endpoint £; maximum time T; constant a; integers m > 2; 
N > 2. 

OUTPUT approximations w,j to u(xi,tj), i = 0, . . . , m, j = 0, . . . , N. 
Algorithm: 

1. Set h = £/m; k = T/N; A = ka/h. 
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2 



For j = 1, . . . , N set wqj = 0; w m j = 0. 
Setw ,o = /(0);w m>0 = f{£). 
Fori = 1, . . . ,m — 1 



3 



4. 



set w^o = f(ih); 



WiA = (l-\i)f(ih) + Y [f((i + l)h) 



+f((i-l)h)]+kg(ih). 



5 



For j = 1, . . . , TV — 1 (Perform matrix multiplication.) 
fori = 1, ... ,m — 1 set 

Wij + i = 2(1 - X 2 )wij + X 2 (w i+1 j + Wj-ij) + 



6. Forj = l,...,iV 

seti = jk; 

for i = 0, . . . ,m 

set x = ih; OUTPUT(a;, t, Wij). 

7. STOP. (Procedure completed.) 



8.3.3 NUMERICAL SUMMATION 

A sum of the form Yl^o f( x o + jh) (n may be in nite) can be approximated by the 
Euler-MacLaurin sum formula, 



where E m = ^^^ / (2m+2) (£)» with x < £ < x + nh. The B n here are 



Bernoulli numbers (see Section 1.2.7). 

The above formula is useful even when n is in nite, although the error can no 
longer be expressed in this form. A useful error estimate (which also holds when n 
is nite) is that the error is less than the magnitude of the rst neglected term in the 
summation on the second line of Equation (8.3.39) if / ( 2m + 2 ) (%) and f( 2m + 4 ) ( x ) do 
not change sign and are of the same sign for xq < x < xq + nh. If just j( 2m + 2 ) (x) 
does not change sign in the interval, then the error is less than twice the rst neglected 
term. 

Quadrature formulae result from Equation (8.3.39) using estimates for the 
derivatives. 
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8.4 PROGRAMMING TECHNIQUES 



Ef cienc y and accuracy are the ultimate goal when solving any problem. Listed 
here are several suggestions to consider when developing algorithms and computer 
programs. 

1 . Every algorithm must have an effective stopping rule. For example, popular 
stopping rules for iteration methods described in Section 8.1.2 are based on 
the estimate of the absolute error, relative error, or function value. One might 
choose to stop when a combination of the following conditions are satis ed: 

I I . \Pn ~ Pn— 1 if/ \i , 

\Pn-Pn-l < £l, i i < £2, /(Pn) < C3, 

\Pn\ 

where each e,: represents a prescribed tolerance. However, since some iter- 
ations are not guaranteed to converge, or converge very slowly, it is recom- 
mended that an upper bound, say N, is sped ed for the number of iterations 
to be performed (see algorithm on page 742). This will avoid in nite loops. 

2. Avoid the use of arrays whenever possible. Subscripted values often do not 
require the use of an array. For example, in Newton's method (see page 731) 
the calculations may be performed using p = po — j^wj ■ Then check the 
stopping rule, say, if \p — po \ < e, and update the current value by setting 
Po = p before computing the next value of the sequence. 

3. Limit the use of arrays when forming tables. A two-dimensional array can 
often be avoided. For example, a divided difference table can be formed and 
printed as a lower triangular matrix. The entries of any row depend only on 
the entries of the preceding row. Thus, one-dimensional arrays may be used 
to save the preceding row and the current row being calculated. It is important 
to note that usually the entire array need not be saved. For example, only 
special values in the table are needed for the coef cients of an interpolating 
polynomial. 

4. Avoid using formulae that may be highly susceptible to round off error. Exer- 
cise caution when computing quotients of extremely small values as in Equa- 
tion (8.3.12) with a very small value of h. 

5. Alter formulae for iterations to obtain a "small correction" to an approxima- 
tion. For example, writing as a -I- in the bisection method (see 
page 732) is recommended. Many of the iteration formulae in this chapter 
have this form. 

6. Pivoting strategies are recommended when solving linear systems to reduce 
round-off error. 

7. Eliminate unnecessary steps that may increase execution time or round-off 
error. 
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8. Some methods converge very rapidly, when they do converge, but rely on rea- 
sonably close initial approximations. A weaker, but reliable, method (such as 
the bisection method) to obtain such an approximation can be combined with a 
more powerful method (such as Newton's method). The weaker method might 
converge slowly and, by itself, is not very ef cien t. The powerful method 
might not converge at all. The combination, however, might remedy both dif- 
culties. 
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7.1 PROBABILITY THEORY 



7.1.1 INTRODUCTION 

A sample space S associated with an experiment is a set S of elements such that any 
outcome of the experiment corresponds to a unique element of the set. An event E is 
a subset of a sample space S. An element in a sample space is called a sample point 
or a simple event. 

7.1.1.1 De nition of probability 

If an experiment can occur in n mutually exclusive and equally likely ways, and if 
exactly m of these ways correspond to an event E, then the probability of E is given 
by 

777 

P(E) = -. (7.1.1) 
n 

If E is a subset of S, and if to each element subset of S, a non-negative number, 
called the probability, is assigned, and if E is the union of two or more different sim- 
ple events, then the probability of E, denoted P(E), is the sum of the probabilities 
of those simple events whose union is E. 

7.1.1.2 Marginal and conditional probability 

Suppose a sample space S is partitioned into rs disjoint subsets where the general 
subset is denoted Ei n Fj (with i = 1,2, ... , r and j = 1, 2, . . . , s). Then the 
marginal probability of Ei is de ned as 

s 

P{E i ) = Y J P(E i nF j ), (7.1.2) 

3 = 1 

and the marginal probability of Fj is de ne d as 

r 

P(F j ) = Y^P(E i nF j ). (7.1.3) 
The conditional probability of E it given that Fj has occurred, is de ned as 

P{E> | Fj) = P( f ( ^ j \ when P(Fj) ± (7.1.4) 
P\ b i) 

and that of Fj, given that Ei has occurred, is de ned as 

P(Fj | Ei) = P{ p ( ^ j \ when P{E t ) * 0. (7.1.5) 
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7.1 .1 .3 Probability theorems 

1. If is the null set, then F(0) = 0. 

2. If S is the sample space, then P(S) = 1. 

3. If F and F are two events, then 

P(E U F) = P{E) + F(F) — P(E (~l F). (7.1.6) 

4. If E and F are mutually exclusive events, then 

P(£UF) = P(B) + P(F). (7.1.7) 

5. If F and E' are complementary events, then 

P(F) = 1 -P(E'). (7.1.8) 

6. Two events are said to be independent if and only if 

P(EDF) = P{E)P{F). (7.1.9) 

The event E is said to be statistically independent of the event F if 
P(E | F) = F(F) and P(F | F) = F(F). 

7. The events {Fi , . . . , F„ } are called mutually independent for all combinations 
if and only if every combination of these events taken any number of times is 
independent. 

8. Bayes' rule: If {Fi, F„} are n mutually exclusive events whose union is 
the sample space S, and if F is any arbitrary event of S such that F(F) ^ 0, 
then 

I F , _ P(E k )P(E\E k ) _ P(E k )P(E\E k ) 

P(E ^ E) - m -Y.UP{E i )p{E\E i y (7 - L10) 

9. For a uniform probability distribution, 

, , . Number of outcomes in event A 

P(A) = —=—. r j— • (7.1.11) 

Total number of outcomes 



7.1.1.4 Terminology 

1 . A function whose domain is a sample space S and whose range is some set 
of real numbers is called a random variable. This random variable is called 
discrete if it assumes only a nite or denumerable number of values. It is 
called continuous if it assumes a continuum of values. 

2. Random variables are usually represented by capital letters. 
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3. "iid" or "i.i.d." is often used for the phrase "independent and identically 
distributed". 

4. Many probability distributions have special representations: 

(a) Xn'- chi-square random variable with n degrees of freedom 

(b) E(\): exponential distribution with parameter A 

(c) N(fi, a): normal random variable with mean p and standard deviation a 

(d) P(A): Poisson distribution with parameter A 

(e) U[a, b): uniform random variable on the interval [a, b) 



7.1.1.5 Characterizing random variables 

The density function is de ned as follows: 

1. When X is a continuous random variable, let f(x) dx denote the probability 
that X lies in the region [x,x + dx]; f(x) is called the probability density 
function. (We require f(x) > and J f(x) dx = 1.) For any event E, 

P(E) = P(X is in E) = [ f{x)dx. (7.1.12) 

■IE 

2. When X is a discrete random variable, let p^ for k = 0,1,... be the proba- 
bility that X = xu (with pj. > and J2 k pj. = 1). Mathematically, for any 
event E, 

P(E) = P(X is in E) = Pk- (7.1.13) 

x h eE 

A discrete random variable can be written with the continuous density 

f( x ) = J2kPk S ( x ~ x k)- 

The cumulative distribution function, or simply the distribution function, is de- 
ned by 

F{x) = P(X <x) = fe><.»> in the di8Crete CaS6 < (7.1.14) 
I J_oo ^ n ^ e contmuous case- 

Note that F(— oo ) = and F(oo) = 1. The probability that X is between a and b is 
P(a < X < b) = P(X < b) - P(X <a) = F(b) - F(a). (7.1.15) 

Let g(X) be a function of X. The expected value (or expectation) of g(X), 
denoted by E [<?(X)], is de ned by 

E[ g (X)} = S^kPk9( x k), in the discrete case, (7.1.16) 
[ J™ g(t)f(t) dt, in the continuous case. 
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1. E [aX + bY] = aE [X] + bE [Y]. 

2. E [XY] = E [X]E [Y] if X and Y are statistically independent. 

The moments of X are de ned by fi' k = E [X k ]. The rst moment, fj,' lt is 
called the mean of X; it is usually denoted by \i = [i\ = E[X]. The centered 
moments of X are de ned by /xj. = E [(X — /x)*] . The second centered moment is 
called the variance and is denoted by a 2 = fi^ = E [(X — /x) 2 ] . Here, <r is called 
the standard deviation. The skewness is 71 = fi^/a 3 , and the excess or kurtosis is 

72 = (^4/cr 4 ) - 3. 

Using <r| to denote the variance for the random variable Z, we have 

1. a 2 cX = c 2 a\. 
3 - = a2 o 2 x- 



7.1 .1 .6 Generating and characteristic functions 

In the case of a discrete distribution, the generating function corresponding to X 
(when it exists) is given by G(s) = Gx(s) = E [s x ] = Y^L PkS Xh ■ From this 
function, the moments may be found from 

(7.1.17) 

s=i 

1. If c is a constant, then the generating function of c + X is s c G(s). 

2. If c is a constant, then the generating function of cX is G(s c ). 

3. If Z = X + Y where X and Y are independent discrete random variables, 
then Gz(s) =G x (s)G Y (s). 

4. If Y = Xi, the {X{\ are independent, and each X, has the common 
generating function Gx(s), then the generating function of Y is [Gx(s)] n . 

In the case of a continuous distribution, the characteristic function correspond- 
ing to X is given by <j>{t) = E [e ux ] = e ttx f(x) dx, the Fourier transform 
of f{x). From this function, the moments may be found: n' n = i~ n (j)^(0). If 
Z = X + Y where X and Y are independent continuous random variables, then 
<Pz(t) =<px(t)<p Y (t). 

The cumulant function is de ned as the logarithm of the characteristic function. 
The n' h cumulant, K n , is de ned as a coef cient in the Taylor series of the cumulant 
function, 

\ogct>(t) = Y,^n- J r - (7.1.18) 

n=0 



A = (^) G(s) 
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Note that k\ = /j, k 2 = a 2 , = /is, and K4 = 114 — 3/i|. For a normal probability 
distribution, k„ = for n > 3. The centered moments in terms of cumulants are 

= K 2 , 
V3= K 3 , 

[14 = K4 + 3k? 2 , (7.1.19) 

= K 5 + IOK3K2, 

= kg + 15k4«2 + IOK3 + 15k|. 



7.1.2 MULTIVARIATE DISTRIBUTIONS 

7.1.2.1 Discrete case 

The £;-dimensional random variable (X\, . . . ,X k ) is a A;-dimensional discrete ran- 
dom variable if it assumes values only at a nite or denumerable number of points 
(xi, . . .,x k ). De ne 

P(X 1 =x u X 2 =x 2 ,...,X k =x k ) = f(x u x 2 ,...,x k ) (7.1.20) 

for every value that the random variable can assume. The function f(x 1 , . . . , x k ) is 
called the joint density of the A;-dimensional random variable. If E is any subset of 
the set of values that the random variable can assume, then 

P(E) =P[(X u ...,X k )i S mE] = Y,f(x u ...,x k ) (7.1.21) 

E 

where the sum is over all the points {x\ , . . . , x k ) in E. The cumulative distribution 
function is de ne d as 

F(x 1 ,x 2 , ■ ■ ■ ,x k ) = ^2 ^2 "' f{zi,z 2 ,...,z k ). (7.1.22) 

Zl<Xl Z2<X 2 Z k <X k 

7.1.2.2 Continuous case 

The k random variables (Xi, . . . , X k ) are said to be jointly distributed if a function 
/ exists so that f(x\ ,x k ) > for all —00 < Xi < 00 (i = 1, . . . , k) and so that, 
for any given event E, 

P(E)=P[(X u X 2 ,...,X k ) isin£] 

= I J ^ Xl ' X2 ' ' ' ' ,Xk ^ dxi dx2 "' dXk ' (7.1.23) 

E 

The function f{x\ , . . . , x k ) is called the joint density of the random variables X\, 
X 2 , . .., X k . The cumulative distribution function is de ned as 

/Xl rX2 PXh 
/ •••/ f(z 1 ,z 2 ,. .. ,z k )dz k ■■■ dz 2 dzi. (7.1.24) 
-00 J —00 J —00 

Given the cumulative distribution function, the probability density may be found 
from 

d d d 

f(x 1 ,x 2 ,...,x k ) = - — — F(x 1 ,x 2 ,. . . ,x k ). (7.1.25) 

OX\ ox 2 ox k 
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7.1.2.3 Moments 

The r th moment of X, is de ned as 

{H Xl • • • J2 Xh x U( x i>- --, x k), in the discrete case, 

OO OO 
J ••• J* x r i f{x\, . . . ,Xk) dx\ • • • dxk in the continuous case. 
— oo —CO 

(7.1.26) 

Joint moments about the origin are de ned as E [Xj^Xj 2 ■ ■ ■ X r k k ] where t\ + r-2 + 
■ ■ ■ + r k is the order of the moment. Joint moments about the mean are de ned as 
E [(X, - ^ (X 2 -^Y 2 --- (X k - n k y*}, where » k =E [X k ]. 



7.1.2.4 Marginal and conditional distributions 

If the random variables Xi, X k have the joint density function f{x\ , . . . , x k ), 
then the marginal distribution of the subset of the random variables, say, X i , . . . , X p 
(withp < k), is given by 

g(x 1 ,x 2 ,...,x p ) = 

J2 Xp+1 J2 Xp+2 ■■■J2 Xk f( x i ,x 2 ,...,x k ), in the discrete case, 

00 00 (7.1.27) 
/ ■■■ / f{x\,...,Xk)dx p+ \ ■ ■ ■ dx k , in the continuous case. 

— oo — oo 

The conditional distribution of a certain subset of the random variables is the 
joint distribution of this subset under the condition that the remaining variables are 
given certain values. The conditional distribution of Xi, X 2 , X p , given X p+ i, 
X p +2, • • ■ , X k , is 

, / , x f(x!,X2,- ■ ■ ,X k ) 

h(xi,. ..,x p x p+ i, . ..,x k ) = — r (7.1.28) 

9{x p +i,x p+2 , ...,x k ) 

tfg(Xp+l,X p+2 ,- ..,X k )^0. 

The variance an of X, and the covariance <T, j of X, and Xj are given by 



al=^=E[(Xi-^], 

°ij = PijViVj = E[(Xj - m){Xj - fij)}, 



(7.1.29) 



where pij is the correlation coefcie nt, and <r, and Oj are the standard deviations of 



X, and Xj . 



7.1 .3 RANDOM SUMS OF RANDOM VARIABLES 

If T = $1 Hi Xi, and if N is an integer-valued random variable with generating 
function Gjv(s), and if the {Xj} are discrete independent and identically distributed 
random variables with generating function Gx(s), and the {X,} are independent of 
N, then the generating function for T is Gt(s) = Gn(Gx(s))- (If the {X,} are 
continuous random variables, then (f>r(t) = GN{<j>x{t))-) Hence, 

1. fir = [J-NfJ-x- 

2. o\ = jJLN<?'x + MX<7%- 
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7.1.4 TRANSFORMING VARIABLES 

1 . Suppose that the random variable X has the probability density function / x (x) 
and the random variable Y is de ned by Y = g(X). If g is measurable and 
one-to-one, then 

fy(y) = fx(h(y)) dh 



dy 



(7.1.30) 



where h(y) = g 1 (y). 



2. If the random variables X and Y are independent and if their densities f x and 
/y, respectively, exist almost everywhere, then the probability density of their 
sum, Z = X + Y, is given by the convolution 

/oo 
fx(x)f Y (z-x)dx. (7.1.31) 
-oo 

3. If the random variables X and Y are independent and if their densities fx and 
fy, respectively, exist almost everywhere, then the probability density of their 
product, Z = XY, is given by the formula, 

f°° 1 / z\ 

fz(z)= —fx(x)f Y (-}dx. (7.1.32) 

J — oo \ x \ x 



7.1 .5 CENTRAL LIMIT THEOREM 

If {Xi} are independent and identically distributed random variables with mean fi 
and nite variance a 2 , then the random variable 

V no- 
tends (as n — > oo) to a normal random variable with mean zero and variance one. 



7.1.6 INEQUALITIES 

1. Markov's Inequality: If X is a random variable which takes only non-negative 
values, then for any a > 0, 

P(X > a) < 51^-1. (7.1.34) 

a 

2. Cauchy-Schwartz Inequality: Let X and Y be random variables for which 
E [X 2 ] andE [Y 2 ] exist, then 

(E [17]) 2 < E [X 2 ] E [Y 2 ] . (7.1.35) 
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3. One-Sided Chebyshev Inequality: Let X be a random variable with zero mean 
(i.e., E [X] = 0) and variance a 2 . Then, for any positive a, 

2 

P(X > a) < ° (7.1.36) 
(j + a 1 

4. Chebyshev 's Inequality: Let c be any real number and let X be a random 
variable for which E [(X - c) 2 ] is nite. Then, for every e > the following 
holds: 

P(\X -c\>e) <^E[(X -c) 2 ]. (7.1.37) 

5. Bienayme-Chebyshev's Inequality: If E[|X| r ] < oo for all r > (r not 
necessarily an integer) then, for every a > 0, 

P(\X\ >a)< E ^ X \ r \ (7.1.38) 



6. Generalized Bienayme-Chebyshev's Inequality: Let g(x) be a non-decreasing 
non-negative function de ned on (0, oo). Then, for a > 0, 

P (|I|> a) < !Ml , (7.1.39) 
9(a) 

7. Chernoff bound: This bound is useful for sums of random variables. Let Y n = 
^2" =1 Xi where the {Xi} are iid. Let M(t) = E x [e tx ] be the same moment 
generating function for each of the and de ne g(t) = logM(i). Then 
(the prime in this formula denotes a derivative), 

P{Y n >ng'(t)) < e - n KW-fl(*)] j ifi>0, 
P{Y n <ng'{t)) < e -»K(*)-flW] j if* < 0. 

8. Kolmogowv 's Inequality: Let Xi, X 2 , ■ ■ ■ , X n be n independent random vari- 
ables such that E [Xi] = and Var(X,) = a\. is nite. Then, for all a > 0, 

PI max \X L +X 2 + ---+Xi\ > a) <V %. (7.1.40) 

x x «— 1 

9. Jensen's Inequality: If E [X] exists, and if /(a;) is a convex U ("convex cup") 
function, then 

E[f(X)]>f(E[X]). (7.1.41) 
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7.1.7 AVERAGES OVER VECTORS 



Let /(n) denote the expectation of the function / as the unit vector n varies uniformly 
in all directions in three dimensions. If a, b, c, and d are constant vectors, then 



|a-n| 2 


= N 2 A 


(a-n)(b-n) 


= (a-b)/3, 


(a • n)n 


= a/3, 


a x n 2 


= 2|a| 2 /3, 


(a x n) • (b x n) 


= 2ab/3, 


(a-n)(b-n)(c-n)(d-n) 


= [(a-b)(c 



(7.1.42) 



Now let /(n) denote the average of the function / as the unit vector n varies 
uniformly in all directions in two dimensions. If a and b are constant vectors, then 



|a-n| 2 = |a| 2 /2, 



(a-n)(b-n) = (a • b)/2, (7.1.43) 



(a • n)n = a/2. 



7.1.8 GEOMETRIC PROBABILITY 

1 . Points in a line segment: 

If A and B are uniformly and independently chosen from the interval [0,1), 
and X is the distance between A and B (that is, X = \A — B\) then the 
probability density of X is fx (x) = 2(1 — x). 

2. Many points in a line segment: 

Uniformly and independently choose n — 1 random values in the interval [0,1). 
This creates n intervals. 

Pk (x) = Probability (exactly k intervals have length larger than x) 

= Q jll-fcz]"" 1 - (^ l ~ k yi-(k + l)x] n - 1 + (7.1.44) 

... + i _ 1 y^-y i _ ik + s)x] n-^ 



where s = 
exceeds x is 



l --k 

x 



. From this, the probability that the largest interval length 



1 - P (x) = [ 1 (1 - x) n ~' " ( 2 ) (1 " 2Z)"- 1 + • • • • (7.1.45) 
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3. Points in the plane: 

Assume that the number of points in any region A of the plane is a Poisson 
variate with mean XA (A is the "density" of the points). Given a x ed point P 
de ne R\ , i? 2 , . . . , to be the distance to the point nearest to P, second nearest 
to P, etc. Then 

fnAr) = ^%r^e-^\ (7 .l.46) 
(s - 1)! 

4. Points in three-dimensional space: 

Assume that the number of points in any volume V is a Poisson variate with 
mean XV (A is the "density" of the points). Given a x ed point P de ne R\, 
i? 2 , . . . , to be the distance to the point nearest to P, second nearest to P, etc. 
Then 

/fl.(r) = ^^r 3 '- 1 e-$*< (7.1.47) 

r(s) 

5. Points on a checkerboard: 

Consider the unit squares on a checkerboard and select one point uniformly 
and independently in each square. The following results concern the average 
distance between points: 

(a) For adjacent squares (a black and white square with a common side) the 
mean distance between points is 1.088. 

(b) For diagonal squares (two white squares with a point in common) the 
mean between points is 1.473. 

6. Points in a cube: 

Choose two points uniformly and independently within a unit cube. The dis- 
tance between these points has mean 0.66171 and standard deviation 0.06214. 

7. Points in an n-dimensional cube: 

Select two points uniformly and independently within a unit n-dimensional 
cube. The expected distance between the points, A(n), is 

A(l) = I A(5) ps 0.87852 

A(2) ps 0.54141 A(6) ps 0.96895 

A(3) ps 0.66171 A(7) ps 1.05159 

A (4) ps 0.77766 A(8) ps 1.12817 

8. Points on a circle: 

Select three points uniformly and independently on a unit circle. These points 
determine a triangle with area A. The mean and variance of this area are: 

HA = 0.4775 

2 3V-6) (7 - L48) 

< = « 0.1470 



© 2003 by CRC Press LLC 



9. Buffon's needle problem: 

A needle of length L is placed at random on a plane on which are ruled parallel 
lines a distance D apart. If ^ < 1 then only one intersection is possible. The 
probability P that the needle intersects a line is 

' 2L 

— ifO <L<D, 

ttD 




if < D < L. 



(7.1.49) 



7.2 CLASSICAL PROBABILITY PROBLEMS 



7.2.1 RAISIN COOKIE PROBLEM 

A baker creates enough cookie dough for C = 1000 raisin cookies. The number of 
raisins to be added to the dough, R, is to be determined. 

1 . If you want to be 99% certain that the r st cookie will have at least one raisin, 
then i _ (C^i)* = i _ > 0.99, or R > 4603. 

2. If you want to be 99% certain that every cookie will have at least one raisin, 
then P(C,R) > 0.99, where P(C,R) = C~ R J2Zo (?) (-!)'(<? " *)*■ 
Hence R > 11508. 



7.2.2 GAMBLER'S RUIN PROBLEM 

A gambler starts with z dollars. For each turn, with probability p he wins one dollar, 
with probability q he loses one dollar (with p + q = 1). Gambling stops when he 
has either last z dollars ("is ruined", the gambler holds zero dollars), or won a — z 
dollars ("gambler's success", the gambler holds a dollars). 

If q z denotes the probability of stopping with zero dollars ("is ruined") then 



f (q/p) a - (q/p) z 



Qz = < 



(q/p) a ~ 1 



l- Z - 
a 



ifp : 



(7.2.1) 
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For example: 





V 


q 


z 


a 


Qz 


fair 


0.5 


0.5 


9 


10 


.900 


game 


0.5 


0.5 


90 


100 


.900 




0.5 


0.5 


900 


1000 


.900 




0.5 


0.5 


9000 


10000 


.900 


biased 


0.4 


0.6 


90 


100 


.017 


game 


0.4 


0.6 


90 


99 


.667 



7.2.3 CARD GAMES 

If the odds are a:b against, the probability of the event is p = If the odds are 
a:b for, the probability of the event is p = 

1. Poker hands 

The number of distinct 5-card poker hands is ( 5 5 2 ) = 2,598,960. 



Hand Probability Odds against 

royal ush 1.54 x 10" 6 = 4/( 5 5 2 ) 649,739:1 

straight ush 1.39 x 10" 5 = 36/( 5 5 2 ) 72,192:1 

fourofakind 2.40 x 10" 4 = 624/ ( 5 5 2 ) 4,164:1 

fullhouse 1.44 x 10" 3 = 3744/ ( 5 5 2 ) 693:1 

ush 1.97xl0- 3 508:1 

straight 3.92 x 10" 3 254:1 

three of a kind 0.0211 46:1 

two pair 0.0475 20:1 

one pair 0.423 = fff 1.37:1 



2. Bridge hands 

The number of distinct 13-card bridge hands is (^ 2 ) = 635,013,559,600. 

In bridge, the honors are the ten, jack, queen, king, and ace of each of the four 
suits. Obtaining the three top cards (ace, king, and queen) of three suits and 
the ace, king, queen, and jack of the remaining suit is called 13 top honors. 
Obtaining all cards of the same suit is called a 13-card suit. Obtaining 12 
cards of the same suit with ace high and the 13th card not an ace is called a 
12-card suit, ace high. Obtaining no honors is called a Yarborough. 



Hand 


Probability 




13 top honors 


6.30 x 


10" 


12 


13-card suit 


6.30 x 


10" 


12 


12-card suit, ace high 


2.72 x 


10" 


9 


Yarborough 


5.47 x 


10" 


4 


four aces 


2.64 x 


10" 


3 


nine honors 


9.51 x 


10" 


3 



Odds against 

4/(^ 2 ) 158,753,389,899:1 
4/Q 158,753,389,899:1 
367,484,698:1 
1,827:1 
378:1 
104:1 
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7.2.4 DISTRIBUTION OF DICE SUMS 

A common die is a cube with six faces; the faces are numbered one through six. It is 
usually unbiased, all faces are equally likely. 

When rolling two dice, the probability distribution of the sum is 

Prob (sum of s) = 6 - ^ - ^ for 2 < s < 12. (7.2.2) 
36 

When rolling three dice, the probability distribution of the sum is 



Prob (sum of s) = < 



'i(s-l)(s-2) for3<s<8 

s 2 + 21s - 83 for 9 < s < 14 (7.2.3) 
i(19 - s)(20 - s) forl5<s<18 



For two dice, the most common roll is a 7 (probability |). For three dice, the 
most common rolls are 10 and 11 (probability i each). For four dice, the most 



common roll is a 14 (probability ^). 



7.2.5 BIRTHDAY PROBLEM 

The probability that n people have different birthdays (neglecting February 29 *) is 



Qn 



/364V (363V.. (366 -^ (7 . 2 . 4) 
1 365; V 365 / V 365 J 



Let p n = 1 — q n . For 23 independent people the probability of at least two people 
having the same birthday is more than half (p 23 = 1 — (723 > 1/2). 



n 10 


20 


23 


30 


40 


50 


Pn 0.117 


0.411 


0.507 


0.706 


0.891 


0.970 



That is, the number of people needed to have a 50% chance of two people having 
the same birthday is 23. The number of people needed to have a 50% chance of three 
people having the same birthday is 88. For four, ve, and six people having the same 
birthday the number of people necessary is 187, 313, and 460. 

The number of people needed so that there is a 50% chance that two people 
have a birthday within one day of each other is 14. In general, in an n-day year the 
probability that p people all have birthdays at least k days apart (so k = 1 is the 
original birthday problem) is 

1 1 *i • fn-p(k-l)-l\(p-l)\ 
probability = ^ / 1 ' . (7.2.5) 

\ p — 1 / n p ~ l 
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7.3 PROBABILITY DISTRIBUTIONS 



7.3.1 DISCRETE DISTRIBUTIONS 

1. Discrete uniform distribution: If the random variable X has a probability den- 
sity function given by 

P(X = x) = f(x) = —, for x = x\ , X2, ■ ■ ■ , x„, (7.3.1) 
n 

then the variable X is said to possess a discrete uniform probability distribu- 
tion. 

Properties: When a;,- = % for i = 1, 2,. . . , n then 

n + 1 



Mean = // 



Variance = a 2 



2 ' 
n 2 -1 



12 

Standard deviation = a - 



(7.3.2) 



Moment generating function = G(t) 



12 ' 
e*(l -e nt ) 
n(l-e') ' 



2. Binomial distribution: If the random variable X has a probability density func- 
tion given by 

P(X=x)=f(x)=(^je x (l-6) n - x , faraj = 0,l,...,n, (7.3.3) 

then the variable X is said to possess a binomial distribution. Note that f(x) 
is the general term in the expansion of [8 + (1 — 0)] 

Properties: 



Mean = p = nG, 
Variance = a 2 = n0(l - 0), 



Standard deviation = a = y/n6{\ — 6), 
Moment generating function = G(t) = [<9e* + (1 - 6)} n . 



(7.3.4) 



As n — > oo the binomial distribution approximates a normal distribution with 
a mean of n9 and variance of n8(l — 8); see Figure 7.1. 

3. Geometric distribution: If the random variable X has a probability density 
function given by 

P(X = x) = f(x) = 8(1 - Of' 1 foxx = 1,2,3,..., (7.3.5) 
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FIGURE 7.1 

Comparison of P(x) for a binomial distribution and the approximating normal distribution. 
Left gure is for (n = 8,8 = 0.2), right gure is for (n = 8,8 = 0.4); horizontal axis is x. 




0.3 



0.2 - 



0.1 




1 2 3 4 5 6 7 



then the variable X is said to possess a geometric distribution. 
Properties: 

Mean = p = i 


Variance = a 2 = —, 



Standard deviation = a = 
Moment generating function = G(t) 



(7.3.6) 



92 ' 



1 - e *(i -ey 



4. Hypergeometric distribution: If the random variable X has a probability den- 
sity function given by 



P(X = x) = f(x) = x forx = 1,2,3,..., min(n,fc) (7.3.7) 



fk\ fN-k\ 
\x ) \n — x ) 

o 

then the variable X is said to possess a hypergeometric distribution. 
Properties: 

Mean = p = — , 

„ . 2 k(N-k)n(N-n) 

Variance = a - 



7V 2 (7V-1) ' (7.3.8) 

Standard deviation = a 



l k(N - k)n(N-n) 
N 2 (N - 1) ' 
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5. Negative binomial distribution: If the random variable X has a probability 
density function given by 

P(X = x)=f(x) = ^ + r _- i yr {l _ ef for* = 0,1,2,..., 

(7.3.9) 

then the variable X is said to possess a negative binomial distribution (also 
known as a Pascal or Polya distribution). 

Properties: 

r 

Mean = p = - — r, 



, r (I \ n 1 0) 
Variance = cr 2 = - | - - 1 ) = v 



o , , , . . r (I A r(l-6) 

Standard deviation =■»/-- — 1 1 - - ■ ' 



(7.3.10) 



2 

ii-r 



Moment generating function = G(t) = 8 r [l - (1 - 0)e ] 

6. Poisson distribution: If the random variable X has a probability density func- 
tion given by 

P(X = x) = f(x) = fora; = 0,l,2,..., (7.3.11) 

with A > 0, then the variable X is said to possess a Poisson distribution. 
Properties: 

Mean = p = A, 

Variance = a 2 = A, 

^ (7.3.12) 
Standard deviation = a = v A, 

Moment generating function = G(i) = e A ^ e 

7. Multinomial distribution: If a set of random variables X\, X 2 , . . . , 1„ has a 
probability function given by 



(7.3.13) 



P(Xi = xi,X 2 = x 2 , ■ ■ ■ ,X n = x n ) = f(xi,x 2 , ■ ■ ■ ,x n ) 

" nxi 

■ , tL l • 

l—l 

where the {xi} are positive integers, each 6i > 0, and 

n n 

5>* = 1 and $>i=^ (7-3.14) 



i=l i=l 



then the joint distribution of Af i, Af 2 , . . . , 1„ is called the multinomial distri- 
bution. Note that f(x\ , x 2 , ■ ■ ■ , x n ) is a term in the expansion of (6\ + 9 2 + 

■■■ + o n ) N . 
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Properties: 

Mean of X, = pi = N6i , 
Variance of X t = o] = N0i{\ - 6i), 
Covariance of X, and Xj = a 2 ^ = —N6i6j, 
Joint moment generating function = (flie* 1 + • • • + 9„e tn ) N . 



(7.3.15) 



7.3.2 CONTINUOUS DISTRIBUTIONS 



1. Uniform distribution: If the random variable X has a density function of the 
form 

f[x) = -J_, for a < x < p, (7.3.16) 

p — a 

then the variable X is said to possess a uniform distribution. 
Properties: 

a + P 



Mean = p 
Variance = a 2 = 
Standard deviation = a = 
Moment generating function = G(t) 



2 ' 
12 





-a) 2 




12 ' 


el 3 


t _ e at 



(P - a)t 



(P - a)t 



sinh 



(P - a)t 



(7.3.17) 



= («+/3)</2 



2. Normal distribution: If the random variable X has a density function of the 
form 



/(*) 



1 



2na 



exp 



2CT 2 



for -oo < x < oo, (7.3.18) 



then the variable X is said to possess a normal distribution. 
Properties: 

Mean = p, 
Variance = a 2 , 
Standard deviation = <r, 



Moment generating function = G(t) = exp ( pi + 



oH 2 



(7.3.19) 
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(a) Set y = to obtain a standard normal distribution. 

(b) The cumulative distribution function is 

F(l) = , w = _^_£ exp (_(i_ri! )d , 



3. Multi-dimensional normal distribution: 

The random vector X is said to be a multivariate normal (or a multi-dimensional 
normal) if and only if the linear combination a T X is normal for all vectors a. If 
the mean of X is p,, and if the second moment matrix R = E [(X — p) (X — p) T ] 
is non-singular, the density function of X is 



f(x) = ■ — . exp 

(27r)«/2^/deti? 



l( X -pf R -\ X -p) 



(7.3.20) 



are 



/oo />oo ^ 

• • • / (x T Mx) /(x) dx 
-oo J — oo 

desired. De ning au = tv(MR) k , we nd: 

4 = 1, 
7i = a\ , 

h=a\+2a 2 , (7.3.21) 

h = a\ + 6aia 2 + 8a 3 , 

7 4 = aj + 12aja 2 + 32aia 3 + 12^ + 48a 4 . 

4. Gamma distribution: If the random variable X has a density function of the 
form 

f{x) = T(l + l aW+« Xae ~ X '^ forO<*<~, (7.3.22) 

with a > — 1 and /? > 0, then the variable X is said to possess a gamma 
distribution. 

Properties: 

Mean = = /?(1 + a), 
Variance = a 2 = fi 2 (l + a), (7 3 23) 



Standard deviation = a = j3\/l + a 
Moment generating function = G{t) = (1 - fit) for t < fi~ x . 

5. Exponential distribution: If the random variable X has a density function of 
the form 

-x/9 

f(x) = — — , for0<a;<oo, (7.3.24) 



© 2003 by CRC Press LLC 



where 9 > 0, then the variable X is said to possess an exponential distribution. 
Properties: 

Mean = p = 9, 

i 

(7.3.25) 



Variance = a 2 = 9 2 , 



Standard deviation = a = 9, 
Moment generating function = G(t) = (1 — 9t) _1 . 

6. Beta distribution: If the random variable X has a density function of the form 
f(x) =B(l + a,l+ P)x a (l - xf = rci + ^+fl *^ 1 " 

(7.3.26) 

for < x < 1, where a > — 1 and /? > — 1, then the variable X is said to 
possess a beta distribution. 

Properties: 

1 + a 

Mean = ^= (73 . 27) 



Variance = a 



2 + a + p' 



(2 + a + /3) 2 (3 + a+ /?) ' 

r m moment about the origin = v 



th A . _ .. _ T(2 + a + /3)r(l + a + r) 



r(2 + a + /i+r)r(l + a)' 

7. Chi-square distribution: If the random variable X has a density function of 
the form 

(n-2)/2 -z/2 

/(x) = /0 - - - for < x < co (7.3.28) 

JV 7 2"/ 2 r(n/2) 

then the variable X is said to possess a chi-square (% 2 ) distribution with n 
degrees of freedom. 

Properties: 

Mean = p = n, 
Variance = a 2 = 2n, (7.3.29) 



Standard deviation = a = V2n. 

(a) If Y\ , Y<i , . . . , Y n are independent and identically distributed normal ran- 

n 

dom variables with a mean of and a variance of 1, then \ 2 = ^i 2 is 

i=l 

distributed as chi-square with n degrees of freedom. 

(b) If X 2 , X2» • • • > Xk> are independent random variables and have chi-square 
distributions with m, n<i, ...,nu degrees of freedom, then J2i=i Xi h as 
a chi-squared distribution with n = J2 i = 1 rii degrees of freedom. 
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8. Snedecor's F -distribution: If the random variable X has a density function of 
the form 

p l n+m \ (m\ m / 2 x (m-2)/2 

f(x) = V 2 ' {n> — w , , forO<a;<oo, (7.3.30) 

r(f)r(f)(i + ^"+^ 2 ' 

then the variable X is said to possess a F-distribution with m and n degrees 
of freedom. 

Properties: 

Mean = n = -, forn > 2, 

n — 2 

2n 2 (m + n-2) c A (7331) 

Variance = — ; — — — , tor n > 4. 

m(n-2) 2 (n-4)' 

TUX I Ti 

(a) The transformation w = — transforms the F-density to the beta 

n 

density. 

(b) If the random variable X has a x 2 -distribution with m degrees of free- 
dom, the random variable Y has a \ 2 -distribution with n degrees of free- 
dom, and X and Y are independent, then F = — is distributed as an 

Y/n 

F-distribution with m and n degrees of freedom. 



9. Student's t-distribution: If the random variable X has a density function of the 
form 

f(x) = ^ 2 ' (n+1)/2 , for -oo < x < oo. (7.3.32) 

then the variable X is said to possess a i-distribution with n degrees of free- 
dom. 

Properties: 

Mean = p = 0, 

Variance = <r = -, torn > 2. 

n — 2 

(a) If the random variable X is normally distributed with mean and vari- 
ance <t 2 , and if Y 2 /a 2 has a x 2 distribution with n degrees of freedom, 

and if X and Y are independent, then t = — ^— is distributed as a 
i-distribution with n degrees of freedom. 



© 2003 by CRC Press LLC 



FIGURE 7.2 

Conceptual layout of a queue. 



Arrivals Queue Servers Departures 




7.4 QUEUING THEORY 

A queue is represented as A/B/c/K/m/Z where (see Figure 7.2): 

1. A and B represent the interarrival times and service times: 

GI general independent interarrival time, 

G general service time distribution, 

Hf. fc-stage hyperexponential interarrival or service time distribution, 

Ef. Erlang-A; interarrival or service time distribution, 

M exponential interarrival or service time distribution, 

D deterministic (constant) interarrival or service time distribution. 

2. c is the number of identical servers. 

3. K is the system capacity. 

4. to is the number in the source. 

5. Z is the queue discipline: 

FCFS rst come, rst served (also known as FIFO: " rst in, rst out"), 

LIFO last in, rst out, 

RSS random, 

PRI priority service. 

When not all variables are present, the trailing ones have the default values, K = oo, 
to = oo, and Z is FIFO. Note that the to and Z are rarely used. 



7.4.1 VARIABLES 

1. Proportions 

(a) a n : proportion of customers that nd n customers already in the system 
when they arrive. 

(b) d n : proportion of customers leaving behind n customers in the system. 
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(c) p n : proportion of time the system contains n customers. 



2. Intrinsic queue parameters 

(a) A: average arrival rate of customers to the system (number per unit time). 

(b) p: average service rate per server (number per unit time), p = 1/E [T s ] . 

(c) u: traf c intensity, u = X/p. 

(d) p: server utilization, the probability that any particular server is busy, 
p = u/c= (\/p)/c. 

3. Derived queue parameters 

(a) L: average number of customers in the system. 

(b) Lq : average number of customers in the queue. 

(c) N: number in system. 

(d) W: average time for customer in system. 

(e) Wq : average time for customer in the queue. 

(f) T s : service time. 

4. Probability functions 

(a) f s (x) : probability density function of customer's service time. 

(b) f w (x): probability density function of customer's time in system. 

(c) tt(z): probability generating function of p n : ir n = ^^Lo^™- 2 ™- 

(d) ttq (z) : probability generating function of the number in the queue. 

(e) a(s): Laplace Transform of f w (x): a(s) = f w (x)e~ xs dx. 

(f) ar(s): Laplace Transform of the service time. 



7.4.2 THEOREMS 

1. Little's law: L = XW and Lq = XWq. 

2. If the arrivals have a Poisson distribution: p n = a n . 

3. If customers arrive one at a time and are served one at a time: a n = d, 

4. For an M/M/l queue with p < 1, 

(a) Pn = (1 - p)p n , 

(b) L = p/(l-p), 

(c) L Q =p*l(l-p), 

(d) W = l/(p - A), 

(e) W Q = pl(p - A), 

(f) 7r(z) = (l-p)/(l-zp), 

(g) a(s) = (A - p)l(\ -p-s). 
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5. For an M/M/c queue with p < 1 (so that p n = np for n = 1, 2, . . . , c and 

/i„ = c/i for n > c), 



(a) Po 

(b) p n 



c!(l-p) 



c-1 
n=0 



Pou n /n\ for n = 0, 1 

Pou n /c\c n ~ c for n > c, 

(c) L Q = p u c p/c\(l- p) 2 , 

(d) W Q = Lq/A, 

(e) W = W Q + 

(f) L = AW. 



; ■ ■ ■ ; ^; 



6. Pollaczek-Khintchine formula: For an M/G/l queue with p < landE [T s 2 ] < oc 



(a) L 

(b) L 

(c) L C 



Lq+ p, 
\W, 
A 2 E[T, 2 ] 

P)' 



2(1 

(d) L Q = \W Q 

(e) 7r(z) = TTQ(z)aT(X - \z), 

(f) 7r Q (z) = (l-p)(l-z)/(a(A- 



Az) -z). 



7. For an M/G/ oo queue 

(a) p„ = e~ u u n /n\, 

(b) 7r(z) = exp (—(1 — z)u). 



8. Erlang B formula: For an M/G/c/c queue, p c = — I — I 

C ' Vi;=o ' / 

9. Distributional form of Little's law. For any single server system for which: (i) 
Arrivals are Poisson at rate A, (ii) all arriving customers enter the system and 
remain in the system until served (i.e., there is no balking or reneging), (iii) the 
customers leave the system one at a time in order of arrival, (iv) for any time t, 
the arrival process after time t and the time in the system for any customer 
arriving before t are independent, then (here L and W do not denote averages) 

(a) tt(z) = a(A(l - z)), 

(b) E[L"] = Y: n k=1 S(n,k)E[(XW) k ] 

where S(n, k) is Stirling number of the second kind. For example: 

i. E [L] = AE [W] (Little's law), 

ii. E [L 2 ] = E [(AW) 2 ] +E[XW}. 
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7.5 MARKOV CHAINS 



A discrete parameter stochastic process is a collection of random variables {X(t), 
t = 0,1,2,. . . }. The values of X(t) are called the states of the process. The col- 
lection of states is called the state space. The values of t usually represent points 
in time. The number of states is either nite or countably in nite. A discrete pa- 
rameter stochastic process is called a Markov chain if, for any set of n time points 
t\ < ti < ■ ■ ■ < t n , the conditional distribution of X(t n ) given values for X(t\), 
X(i 2 ), . . . , X(t n -\) depends only on X(t n -\). It is expressed by 

P[X(t n ) <x n \X(t 1 )=x 1 ,...,X(t n - 1 )=x n - 1 ] 

= P [X(t n ) < x n | A-(t„_i) = z„_i] . (7.5.1) 

A Markov chain is said to be stationary if the value of the conditional probability 
P [X(t„+i) = x n+ i \X(t n ) = x n ] is independent of n. This discussion will be re- 
stricted to stationary Markov chains. 



7.5.1 TRANSITION FUNCTION AND MATRIX 
7.5.1.1 Transition function 

Let x and y be states and let {t n } be time points in T = {0,1,2,...}. The transition 
function, P(x, y), is de ned by 

P(x, y) = P„,„+i (x, y)=P [X(t n+1 ) = y \ X(t n ) = x] , t n , t n+1 G T. 

(7.5.2) 

P(x,y) is the probability that a Markov chain in state x at time t n will be in state 
y at time t n +i . Some properties of the transition function are that P(x, y) > and 
J2 y P(x, y) = 1. The values of P(x, y) are commonly called the one-step transition 
probabilities. 

The function tto{x) = P(X(0) = x), with tto{x) > and J2 x tto{x) = 1, is 
called the initial distribution of the Markov chain. It is the probability distribution 
when the chain is started. Thus, 

P[X(0)=x o ,X(l)=x u ...,X(n)=x n ] 

= iro(xo)Po ! i(x ,xi)Pi ! 2(xi,X2) ■ ■ ■ P n -i, n (x n -i,x n ). (7.5.3) 



7.5.1.2 Transition matrix 

A convenient way to summarize the transition function of a Markov chain is by using 
the one-step transition matrix. It is de ned as 

-P(0,0) P(0,1) ... P(0,n) .. 
P(1,0) P(l,l) ... P(l,n) .. 



P(n,0) P(n,l) 



P(n,n) 



(7.5.4) 
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De ne the n-step transition matrix by P {n > as the matrix with entries 

(x, y)=P [X(t m+n ) = y | X(t m ) = x] . (7.5.5) 

This can be written in terms of the one-step transition matrix as = P™. 

Suppose the state space is nite. The one-step transition matrix is said to be 
regular if, for some positive power m, all of the elements of P m are strictly positive. 

THEOREM 7.5.1 ( Chapman-Kolmogorov equation ) 

Let P(x, y) be the one-step transition function of a Markov chain and dene 
P(°\x,y) = 1, if x = y, andO, otherwise. Then, for any pair of non-negative 
integers, s and t, such that s + t = n, 

P (n) (*,!/) = £ P (S) (x, Z)PM (z,y). (7.5.6) 

Z 



7.5.2 RECURRENCE 

De ne the probability that a Markov chain starting in state x returns to state x for 
the rst time after n steps by 

f n (x, x)=P \X(t n ) = x, A-(t„_i) ?x,..., X(h) ? x | X(t ) = x] . (7.5.7) 

It follows that P n (x, x) = f k ( x i x)P n ~ k (x, x). A state x is said to be recur- 

rent if Yln°=i f n ( x ' x ) = This means that a state x is recurrent if, after starting 
in x, the probability of returning to it after some nite length of time is one. A state 
which is not recurrent is said to be transient. 

THEOREM 7.5.2 

A state x of a Markov chain is recurrent if and only if Y^n°=i P n ( x i x ) = °°- 

Two states, x and y, are said to communicate if, for some n > 0, P n (x, y) > 
0. This theorem implies that, if a; is a recurrent state and x communicates with y, 
y is also a recurrent state. A Markov chain is said to be irreducible if every state 
communicates with every other state and with itself. 

Let a; be a recurrent state and de ne T x the {return time) as the number of stages 
for a Markov chain to return to state x, having begun there. A recurrent state x is 
said to be null recurrent if E [T x ] = oo. A recurrent state that is not null recurrent is 
said to be positive recurrent. 



7.5.3 STATIONARY DISTRIBUTIONS 

Let {X(t),t = 0,1,2,...} be a Markov chain having a one-step transition function 
P(x,y). A function tt(x) where each tt(x) is non-negative, ^2 x ir(x)P(x,y) = 
ir(y), and ^ Tr(y) = 1, is called a stationary distribution. If a Markov chain has a 
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stationary distribution and lim„_ i>00 P n (x, y) = ir(y) for every x, then, regardless of 
the initial distribution, tto(x), the distribution of X(t n ) approaches ir(x) as n tends to 
in nity . When this happens, n(x) is often referred to as the steady state distribution. 
The following categorizes those Markov chains with stationary distributions. 



THEOREM 7.5.3 

Let Xp denote the set of positive recurrent states of a Markov chain. 

1. IfXp is empty, the chain has no stationary distribution. 

2. If Xp is a non-empty irreducible set, the chain has a unique stationary 
distribution. 

3. If Xp is non-empty but not irreducible, the chain has an in n ite number of 
distinct stationary distributions. 



The period of a state x is denoted by d(x) and is de ned as the greatest common 
divisor of all integers, n > 1, for which P n (x,x) > 0. If P n (x,x) = for all 
n > 1, then de ne d(x) = 0. If each state of a Markov chain has d(x) = 1, the chain 
is said to be aperiodic. If each state has period d > 1, the chain is said to be periodic 
with period d. The vast majority of Markov chains encountered in practice are ape- 
riodic. An irreducible, positive recurrent, aperiodic Markov chain always possesses 
a steady-state distribution. An important special case occurs when the state space is 
nite. Suppose that X = {1,2, . . . ,K}. Let7r = {7r (l), 7r (2), . . . ,ir (K)}. 



THEOREM 7.5.4 

Let P be a regular one-step transition matrix and ttq be an arbitrary vector of initial 
probabilities. Then Ibxin^oo n (x)P" =y, where yP =y, and Y,i=i na(Vi) = 1 - 



7.5.3.1 Example: A simple three-state Markov chain 

A Markov chain having three states {0, 1,2} with a one-step transition matrix of 







2 

1 3 

4 4 

° ! 



is diagrammed below. 



3/4 
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The one-step transition matrix gives a two-step transition matrix 



4 



3 
8 



3 
8 



p(2) = p2 



_5_ 

16 



_9_ 

16 



8 



(7.5.8) 



16 



3 
4 



16 



The one-step transition matrix is regular. This Markov chain is irreducible, and all 
three states are recurrent. In addition, all three states are positive recurrent. Since all 
states have period 1, the chain is aperiodic. The unique steady state distribution is 
tt(0) = 3/11, tt(1) = 6/11, and tt(2) = 2/11. 



7.5.4 RANDOM WALKS 

Let rj(ti), 77(^2), ■ ■ ■ be independent random variables having a common density 
f(x), and let £1, £2, ■ ■ ■ be integers. Let X be an integer- valued random variable 
that is independent of r?(£i), ^(£2), • • ■ , and X(t n ) = X + viU)- The se- 

quence {X(ti),i = 0, 1, . . . } is called a random walk. An important special case is 
a simple random walk. It is de ned by 



Here, an object begins at a certain point in a lattice and at each step either stays at 
that point or moves to a neighboring lattice point. 

This one-dimensional random walk can be extended to higher-dimensional lat- 
tices. A common case is that an object can only transition to an adjacent lattice 
point, and all such transitions are equally likely. In this case, with a one- or two- 
dimensional lattice, if a random walk begins at a lattice point x, then it will return to 
that lattice point with probability 1. In this case, with a three-dimensional lattice, the 
probability that it will return to its starting point is only about 0.3405. 



A simple model of gas exchange between two isolated bodies is as follows. Suppose 
that there are two boxes, Box I and Box II, where Box I contains K molecules 
numbered 1,2, ... ,K and Box II contains N — K molecules numbered K + 1, K + 
2, . . . , N . A number is chosen at random from {1,2,..., N}, and the molecule with 
that number is transferred from its box to the other one. Let X(t„) be the number 
of molecules in Box I after n trials. Then the sequence {X(t n ),n = 0, 1, . . . } is a 
Markov chain with one-stage transition function of 




where p + q + r = 1, and P(0, 0) = p + r. 



(7.5.9) 



7.5.5 EHRENFEST CHAIN 




y = x-l, 
y = x + 1, 
otherwise. 



P(x,y) = jl-f, 

.0. 



(7.5.10) 
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7.6 RANDOM NUMBER GENERATION 



7.6.1 METHODS OF PSEUDORANDOM NUMBER GENERATION 

In Monte Carlo applications, and other computational situations where randomness 
is required, one must appeal to random numbers for assistance. While it has been 
argued that numbers measured from a physical process known to be random should 
be used, it has been in nitely more practical to use simple recursions that produce 
numbers that behave as random in applications and with respect to statistical tests 
of randomness. These are so-called pseudorandom numbers and are produced by 
a pseudorandom number generator (PRNG). Depending on the application, either 
integers in some range or oating point numbers in [0, 1) are the desired output from 
a PRNG. Since most PRNGs use integer recursions, a conversion into integers in a 
desired range or into a oating point number in [0, 1) is required. If x „ is an integer 
produced by some PRNG in the range < x n < M — 1, then an integer in the range 
< x n < N - 1, with N < M, is given by y n = [jfX n \ . If N <C M, then 
Vn = %n (mod N) may be used. Alternately, if a oating point value in [0, 1) is 
desired, let y n = x n /M. 

7.6.1.1 Linear congruential generators 

Perhaps the oldest generator still in use is the linear congruential generator (LCG). 
The underlying integer recursion for LCGs is 

x n = ax„-i + b (mod M). (7.6.1) 

Equation (7.6.1) de nes a periodic sequence of integers modulo M starting with x o, 
the initial seed. The constants of the recursion are referred to as the modulus M, 
multiplier a, and additive constant b. If M = 2 m , a very ef cient implementation is 
possible. Alternately, there are theoretical reasons why choosing M prime is optimal. 
Hence, the only moduli that are used in practical implementations are M = 2 m or 
the prime M = 2 P — 1 (i.e., M is a Mersenne prime). With a Mersenne prime or any 
modulus "close to" 2 P , modular multiplication can be implemented at about twice 
the computational cost of multiplication modulo 2 P . 

Equation (7.6.1) yields a sequence {x n } whose period, denoted Per(x n ), de- 
pends on M, a, and b. The values of the maximal period for the three most common 
cases used and the conditions required to obtain them are 



a 


b 


M 


Per(a;„) 


Primitive root of M 
3 or 5 (mod 8) 
1 (mod 4) 


Anything 


1 (mod 2) 


Prime 

2 m 

2 m 


M - 1 
2 m 



A major shortcoming of LCGs modulo a power-of-two compared with prime 
modulus LCGs derives from the following theorem for LCGs: 
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THEOREM 7.6.1 



Dene the following LCG sequence: x n = ax n -\ + b (mod Mi). If Mi divides 
Mi then y n = x n (mod Mi) satis es y n = ay n -i + b (mod Mi). 

Theorem 7.6.1 implies that the k least-signi cant bits of any power-of-two modulus 
LCG with Per(a;„) = 2™ = M has Per(y„) = 2 k , < k < m. Since a long period 
is crucial in PRNGs, when these types of LCGs are employed in a manner that makes 
use of only a few least-signi cant- bits, their quality may be compromised. When M 
is prime, no such problem arises. 

Since LCGs are in such common usage, here is a list of parameter values men- 
tioned in the literature. The Park-Miller LCG is widely considered a minimally ac- 
ceptable PRNG. Using any values other than those in the following table may result 
in a "weaker" LCG. 



a 


b 


M 


Source 


? 5 





2 31 -1 


Park-Miller 


131 





2 35 


Neave 


16333 


25887 


2 15 


Oakenfull 


3432 


6789 


9973 


Oakenfull 


171 





30269 


Wichman-Hill 



7.6.1.2 Shift-register generators 

Another popular method of generating pseudorandom numbers is using binary shift- 
register sequences to produce pseudorandom bits. A binary shift-register sequence 
(SRS) is de ned by a binary recursion of the type, 

x n = x n-ji © x n-j 2 © ' ' ' © x n-j h i Jl < J2 < ' ' ' < jk = A (7.6.2) 

where ffi is the exclusive "or" operation. Note that x ffi y = x + y (mod 2) . Thus the 
new bit, x n , is produced by adding k previously computed bits together modulo 2. 
The implementation of this recurrence requires keeping the last I bits from the se- 
quence in a shift register, hence the name. The longest possible period is equal to the 
number of non-zero ^-dimensional binary vectors, namely 2 * — 1. 

A suf cient condition for achieving Per(a;„) = 2 e — 1 is that the characteristic 
polynomial, corresponding to Equation (7.6.2), be primitive modulo 2. Since prim- 
itive trinomials of nearly all degrees of interest have been found, SRSs are usually 
implemented using two-term recursions of the form, 

x n = x n - k ®x n -i, < k < I. (7.6.3) 

In these two-term recursions, k is the lag and I is the register length. Proper choice 
of the pair (£, k) leads to SRSs with Per(a;„) =2^ — 1. Here is a list with suitable 
(£, k) pairs: 



Primitive trinomial exponents 


(5,2) 


(7,1) 


(7,3) 


(17,3) 


(17,5) 


(17,6) 


(31,3) 


(31,6) 


(31,7) 


(31,13) 


(127,1) 


(521,32) 
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7.6.1.3 Lagged-Fibonacci generators 

Another way of producing pseudorandom numbers uses lagged-Fibonacci genera- 
tors. The term "lagged-Fibonacci" refers to two-term recurrences of the form, 

x n = x n - k o x n -i, < k < £, (7.6.4) 

where o refers to one of the three common methods of combination: (1) addition 
modulo 2 m , (2) multiplication modulo 2 m , or (3) bitwise exclusive 'OR'ing of m- 
long bit vectors. Combination method (3) can be thought of as a special implemen- 
tation of a two-term shift-register sequence. 

Using combination method (1) leads to additive lagged-Fibonacci sequences 
(ALFSs). If x n is given by 

x n = x n - k + x n -t (mod 2 m ), < k < £, (7.6.5) 

then the maximal period is Per(a;„) = (2 l — l)2 m_1 . 

ALFSs are especially suitable for producing oating point deviates using the 
real-valued recursion y n = y n -k + Vn-e (mod 1). This circumvents the need to 
convert from integers to oating point values and allows oating point hardware to 
be used. One caution with ALFSs is that Theorem 7.6.1 holds, and so the low-order 
bits have periods that are shorter than the maximal period. However, this is not nearly 
the problem as in the LCG case. With ALFSs, the j least-signi cant bits will have 
period (2 e — 1)2 J_1 , so, if £ is large, there really is no problem. Note that one can 
use the table of primitive trinomial exponents to nd (£, k) pairs that give maximal 
period ALFSs. 

7.6.1.4 Non-linear generators 

A recent development among PRNGs are non-linear integer recurrences. For exam- 
ple, if in Equation (7.6.4) "o" referred to multiplication modulo 2 m , then this recur- 
rence would be a multiplicative lagged-Fibonacci generator (MLFG), a non-linear 
generator. The mathematical structure of non-linear generators is qualitatively dif- 
ferent than that of linear generators. Thus, their defects and de cienc ies are thought 
to be complementary to their linear counterparts. 

The maximal period ofa MLFG is Per (x „) = (2 e — l)2 m_3 , a factor of 4 shorter 
than the corresponding ALFS. However, there are bene ts to using multiplication as 
the combining function due to the bit mixing achieved. Because of this, the perceived 
quality of the MLFG is considered superior to an ALFS with the same lag, £. 

We conclude by de ning two non-linear generators, the inversive congruential 
generators (ICGs), which were designed as non-linear analogs of the LCG. 

1 . The implicit ICG is de ned by the following recurrence that is almost that of 
an LCG 

x„ = ax„-i + b (mod M). (7.6.6) 

The difference is that we must also take the multiplicative inverse of x n -\, 
which is de ned by x n -\ x n -\ = 1 (mod M), and = 0. This recurrence 
is indeed non-linear, and avoids some of the problems inherent in linear recur- 
rences, such as the fact that linear tuples must lie on hyperplanes. 
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2. The explicit ICG is 

x n = an + b (mod M). (7.6.7) 

One drawback of ICGs is the cost of inversion, which is 0(log 2 M) times the cost 
of multiplication modulo M. 



7.6.2 GENERATING NON-UNIFORM RANDOM VARIABLES 

Suppose we want deviates from a distribution with probability density function f(x) 
and distribution function F(x) = f*^ f{u) du. In the following "y is U[0, 1)" 
means y is uniformly distributed on [0, 1). 

Two general techniques for converting uniform random variables into those from 
other distributions are as follows: 

1 . The inverse transform method: 

If y is J7[0, 1), then the random variable F~ 1 (y) will have its density equal to 
f(x). (Note that F~ 1 (y) exists since < F(x) < 1.) 

2. The acceptance-rejection method: 

Suppose the density can be written as f(x) = Ch(x)g(x) where h(x) is the 
density of a computable random variable, the function g satis es < g(x) < 1, 
and C _1 = h(u)g{u) du is a normalization constant. If x is J7[0, 1), y 
has density h(x), and if x < g(y), then x has density f(x). Thus one generates 
{x, y} pairs, rejecting both if x > g(y) and returning x if x < g(y)- 

Examples of the inverse transform method: 

1. Exponential distribution: The exponential distribution with rate A has f(x) = 
\e~ Xx (for x > 0) and F(x) = 1 — e~ Xx . Thus u = F(x) can be solved to 
give x = F _1 (u) = -A -1 ln(l - u). If u is U[0, 1), then so is 1 - u. Hence 
x = —A -1 In u is exponentially distributed with rate A. 

2. Normal distribution: Suppose the z^s are normally distributed with density 
function f(z) = -^==e~ z I 2 . The polar transformation then gives random 

variables r = \j z\ + z\ (exponentially distributed with A = 2) and 6 = 
tan -1 (zijz\) (uniformly distributed on [— f,f]). Inverting these relation- 
ships results in z\ = ^—2\nxi cos 2ttx2 and Z2 = ^—2lnx\ sin 2ttx2 ; each 
is normally distributed when x\ and x^ are U[0, 1). (This is the Box-Muller 
technique) 

Examples of the rejection method: 

1. Exponential distribution with A = 1: 

(a) Generate random numbers {U^f^ uniformly in [0, 1], stopping at N = 
min{n \U 1 >U 2 > tf„_i < £/„}. 

(b) If N is even, accept that run, and go to step (c). If N is odd reject the 
run, and return to step (a). 
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(c) Set X equal to the number of failed runs plus U 1 (the rst random num- 
ber in the successful run). 

2. Normal distribution: 

(a) Select two random variables (Vi , V 2 ) from J7[0, 1). Form R = + V 2 2 . 

(b) If R > 1, then reject the (Vi , V 2 ) pair, and select another pair. 

(c) If R < 1, then x = Vi ^/-2^^ has a AT(0, 1) distribution. 

3. Normal distribution: 

(a) Select two exponentially distributed random variables with rate 1 : (V\ , V 2 ) ■ 

(b) IfV2 > (Vi — l) 2 /2, then reject the (Vi, V 2 ) pair, and select anotherpair. 

(c) Otherwise, Vi has a iV(0, 1) distribution. 

4. Cauchy distribution: To generate values of X from /(x) = n ^\ x '2^ on —00 < 
x < 00, 

(a) Generate random numbers £/i, f/ 2 (uniform on [0, 1)), and set 

y 1 = [/ 1 -i,y 2 = [/ 2 -i. 

(b) If Yj 2 + Y 2 2 < i , then return X = Y 1 /Y 2 . Otherwise return to step (a). 
To generate values of X from a Cauchy distribution with parameters /3 and 8, 

/(x) = — — - — y — — , for —00 < x < 00, construct X as above, and 

7T [/r + (x - 6>) J J 

then use /3X + 9. 



7.6.2.1 Discrete random variables 

The density function of a discrete random variable that attains nitely many values 
can be represented as a vector p = (po,Pi, ■ ■ ■ ,Pn-i,Pn) by de ning the probabili- 
ties P(x = j) = pj (for j = 0, . . . , n). The distribution function can be de ne d by 
the vector c = (co, c\ , . . . , c„_i , 1), where cj = 'Yl,\ =Q Pi- Given this representation 
of F(x), we can apply the inverse transform by computing x to be U[0, 1), and then 
nding the index j so that cj < x < Cj+i . In this case event j will have occurred. 
Examples: 

1 . (Binomial distribution) The binomial distribution with n trials of mean p has 
Pj ={1)pl(l-p) n -j,fmj = 0,...,n. 

(a) As an example, consider the result of ipping a fair coin. In 2 ips, the 
probability of obtaining (0, 1,2) heads is p = {\,\,\). Hence c = 
(i, f , 1). If x (chosen from J7[0, 1)) turns out to be say, 0.4, then "1 
head" is returned (since \ < 0.4 < |). 

(b) Note that, when n is large, it is costly to compute the density and distri- 
bution vectors. When n is large and relatively few binomially distributed 
pseudorandom numbers are desired, an alternative is to use the normal 
approximation to the binomial. 
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(c) Alternately, one can form the sum Y^=\ l u i + P_I> wnere eacn u% is 
C/[0,1). 



2. (Geometric distribution) To simulate a value from P(X = i) 

\ogU 



p(l- py- 



fovi > 1, use X = 1 + 



log(l - p) 



3. (Poisson distribution) The Poisson distribution with mean A hasp j = A J e _A /j! 
for j > 0. The Poisson distribution counts the number of events in a unit time 
interval if the times are exponentially distributed with rate A. Thus if the times 
ti are exponentially distributed with rate A, then j will be Poisson distributed 



with mean A when Y^%=o U < 



1 < 1- 



Since ti 



-A lnw,-, where 



Ui is U[0, 1), the previous equation may be written as Hi=o u * — e — 



n^Zo u i- This allows us to compute Poisson random variables by iteratively 

computing Pj = Y\i=o Ui unt ^ < e_A - ^ ne rst sucn mat ma k es tms 
inequality true will have the desired distribution. 



Random variables can be simulated using the following table (each U and U « is 
uniform on the interval [0, 1)): 



Distribution 


Density 


Formula for deviate 


Binomial 


Pj=(^jP i {l-p) n - i 


n 
i=l 


Cauchy 




a tan(7rC/) 


Exponential 


f{x) = \e~ Xx 


-A -1 In 17 


Pareto 


fix) = ab a /x a+1 




Rayleigh 


fix) =x/ae- x ^ 2<j2 





7.6.2.2 Testing pseudorandom numbers 

The prudent way to check a complicated computation that makes use of pseudoran- 
dom numbers is to run it several times with different types of pseudorandom number 
generators and see if the results appear consistent across the generators. The fact that 
this is not always possible or practical has led researchers to develop statistical tests 
of randomness that should be passed by general purpose pseudorandom number gen- 
erators. Some common tests are the spectral test, the equidistribution test, the serial 
test, the runs test, the coupon collector test, and the birthday spacing test. 
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7.7 CONTROL CHARTS AND RELIABILITY 



7.7.1 CONTROL CHARTS 

Control charts are graphical tools used to assess and maintain the stability of a pro- 
cess. They are used to separate random variation from sped c causes. Data mea- 
surements are plotted versus time along with upper and lower control limits and a 
center line. If the process is in control and the underlying distribution is normal, then 
the control limits represent three standard deviations from the center line (mean). 

If all of the data points are contained within the control limits, the process is con- 
sidered stable and the mean and standard deviations can be reliably calculated. The 
variations between data points occur from random causes. Data outside the control 
limits or forming abnormal patterns point to unstable, out-of-control processes. 

In the tables, k denotes the number of samples taken, i is an index for the sam- 
ples (i = 1 ... k), n is the sample size (number of elements in each sample), and 
R is the range of the values in a sample (maximum element value minus minimum 
element value). The mean is [i and the standard deviation is a. Control chart upper 
and lower control limits are denoted UCL and LCL. 



Types of control charts, their statistics, and uses 



Chart 


Statistics 


Statistical quantity 


Applications 


x — R 


Gaussian 


Average value and range 


Charts continuous measurable quantities. Measurements taken on 
small sample sets. 


x-R 


Gaussian 


Median value and range 


Similar to x — R chart but fewer calculations needed for plotting. 


x — Rs 


Gaussian 


Individual measured values 


Similar to x — R chart but single measurements are made. Used 
when measurements are expensive or dispersion of measured 
values is small. Rs = \xi — Xi-\\. 


pn 


Binomial 


Number of defective units 


Charts number of defective units in sets of x ed size. 


P 


Binomial 


Percent defective 


Charts number of defective units in sets of varying size. 


c 


Poisson 


Number of defects 


Charts number of a ws in a product of x ed size. 


u 


Poisson 


Defect density (defects per quantity unit) 


Charts the defect density on a product of varying size. 
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Types of control charts and limits ("P" stands for parameter) 



Chart 


known? 


P 


Centerline 


UCL 


LCL 


x — R 


No 




= 

x - k 


Ju 1 Jl ^ J. L 




x — R 


No 


n 


"r — E_R 


DiR 




x — R 


Yes 








U - -22- 


x — xt 


Vac 

ies 


D 
-ft 


~p J _ 

-ft — «2<7 






X — xt 


INO 


X 


x — —, — 

k 




x — m^A^ 


X — -ft 


1NO 


D 
-ft 


R- — 




Usri 


x — Rs 


No 




— — 2> 
— fc 


t 4- 2 


T — 2 fifi7?«? 




No 


Rs 


o E*£ 

J. 


3 ,2TRs 




pn 


No 


pn 


— V] pn 

pn = 


pn + ^pn(l — p) 


pn — Vpn(l — p) 


V 


No 


V 




pn + 3^/^1 


pn-3^/^ 


c 


No 


c 




c + 


c — 3\/E 


u 


No 


u 




W + 3,/^ 

V n 





Sample size n 


A 2 


d 2 


Di 


D 2 


D 3 


D 4 


m 3 


m 3 A 2 


2 


1.880 


1.128 





3.686 




3.267 


1.000 


1.880 


3 


1.023 


1.693 





4.358 




2.575 


1.160 


1.187 


4 


0.729 


2.059 





4.698 




2.282 


1.092 


0.796 


5 


0.577 


2.326 





4.918 




2.115 


1.198 


0.691 


6 


0.483 


2.534 


j 


5.078 




2.004 


1.135 


0.549 


7 


0.419 


2.704 


0.205 


5.203 


0.076 


1.924 


1.214 


0.509 


8 


0.373 


2.847 


0.387 


5.307 


0.136 


1.864 


1.160 


0.432 


9 


0.337 


2.970 


0.546 


5.394 


0.184 


1.816 


1.223 


0.412 


10 


0.308 


3.078 


0.687 


5.469 


0.223 


1.777 


1.176 


0.363 


11 


0.285 


3.173 


0.812 


5.534 


0.256 


1.744 






12 


0.266 


3.258 


0.924 


5.592 


0.284 


1.716 






13 


0.249 


3.336 


1.026 


5.646 


0.308 


1.692 






14 


0.235 


3.407 


1.121 


5.693 


0.329 


1.671 






15 


0.223 


3.472 


1.207 


5.737 


0.348 


1.652 






16 


0.212 


3.532 


1.285 


5.779 


0.364 


1.636 






17 


0.203 


3.588 


1.359 


5.817 


0.379 


1.621 






18 


0.194 


3.640 


1.426 


5.854 


0.392 


1.608 






19 


0.187 


3.689 


1.490 


5.888 


0.404 


1.596 






20 


0.180 


3.735 


1.548 


5.922 


0.414 


1.586 






21 


0.173 


3.778 


1.605 


5.951 


0.425 


1.575 






22 


0.167 


3.819 


1.659 


5.979 


0.434 


1.566 






23 


0.162 


3.858 


1.710 


6.006 


0.443 


1.557 






24 


0.157 


3.895 


1.759 


6.031 


0.452 


1.548 






25 


0.153 


3.931 


1.806 


6.056 


0.459 


1.541 
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Abnormal Distributions of Points in Control Charts 



Abnormality 


Description 


Sequence 


Seven or more consecutive points on one side of the 
center line. Denotes the average value has shifted. 


Bias 


Fewer than seven consecutive points on one side of the 
center line, but most of the points are on that side. 

• 10 of 1 1 consecutive points 

• 12 or more of 14 consecutive points 

• 14 or more of 17 consecutive points 

• 16 or more of 20 consecutive points 


Trend 


Seven or more consecutive rising or falling points. 


Approaching the limit 


Two out of three or three or more out of seven 
consecutive points are more than two-thirds the 
distance from the center line to a control limit. 


Periodicity 


The data points vary in a regular periodic pattern. 



7.7.2 ACCEPTANCE SAMPLING 



Expression 


Meaning 


AQL 
AOQ 
AOQL 

LTPD 

producer's risk 
consumer's risk 


acceptable quality level 
average outgoing quality 

average outgoing quality limit (maximum value of 

AOQ for varying incoming quality) 

lot tolerance percent defective 

Type 1 error (percentage of "good" lots rejected) 

Type 11 error (percentage of "bad" lots accepted) 



Military standard 105 D is a widely used sampling plan. There are three general 
levels of inspection corresponding to different consumer's risks. (Inspection level II 
is usually chosen; level I uses smaller sample sizes and level III uses larger sample 
sizes.) There are also three types of inspections: normal, tightened, and reduced. 
Tables are available for single, double, and multiple sampling. 

To use MIL-STD-105 D for single sampling, determine the sample size code 
letter from Figure 7.3. Using this sample size code letter nd the sample size and the 
acceptance and rejection numbers from the table on page 654. 

EXAMPLE Suppose that MIL-STD-105 D is to be used with incoming lots of 1,000 
items, inspection level II is to be used in conjunction with normal inspection, and an 
AQL of 2.5 percent is desired. How should the inspections be carried out? 

1. From Figure 7.3 the sample size code letter is J. 

2. From page 654, for column J, the lot size is 80. Using the row labeled 2.5 the accep- 
tance number is 5 and the rejection number is 6. 

3. Thus, if a single sample of size 80 (selected randomly from each lot of 1,000 items) 
contains 5 or fewer defectives then the lot is to be accepted. If it contains 6 or more 
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FIGURE 7.3 

Sample size code letters for MIL-STD-105 D. 



Lot or batch size 


general inspection levels 


I 


II 


in 


2 


to 


8 


A 


A 


B 


9 


to 


15 


A 


B 


C 


16 


to 


25 


B 


C 


D 


26 


to 


50 


C 


D 


E 


51 


to 


90 


C 


E 


F 


91 


to 


150 


D 


F 


G 


151 


to 


280 


E 


G 


H 


281 


to 


500 


F 


H 


J 


501 


to 


1,200 


G 


J 


K 


1,201 


to 


3,200 


H 


K 


L 


3,201 


to 


10,000 


J 


L 


M 


10,001 


to 


35,000 


K 


M 


N 


35,001 


to 


150,000 


L 


N 


P 


150,001 


to 


500,000 


M 


P 


Q 


500,001 


and 


over 


N 


Q 


R 



defectives, then the lot is to be rejected. 



7.7.3 RELIABILITY 

1. The reliability of a product is the probability that the product will function 
within speci ed limits for at least a speci ed period of time. 

2. A series system is one in which the entire system will fail if any of its compo- 
nents fail. 

3. A parallel system is one in which the entire system will fail only if all of its 
components fail. 

4. Let Ri denote the reliability of the i th component. 

5. Let R s denote the reliability of a series system. 

6. Let R p denote the reliability of a parallel system. 



The product law of reliabilities states 

n 

R s = l[Ri (7.7.1) 



The product law of unreliabilities states 



R P = l-H(l-R i )- (7.7.2) 
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7.7.4 FAILURE TIME DISTRIBUTIONS 

1 . Let the probability of an item failing between times t and t + At be f(t)At + 
o(At) as At -» 0. 

2. The probability that an item will fail in the interval from to t is 

I dx. (7.7.3) 



F(t)= f/W' 
Jo 



3. The reliability function is the probability that an item survives to time t 

R(t) = 1 -F(t). (7.7.4) 

4. The instantaneous hazard rate, Z(t), is approximately the probability of fail- 
ure in the interval from t to t + At, given that the item survived to time t 

Z ^-W) = T%- <"' 5 > 

Note the relationships: 

R(t) = e ~ & z(x) dx f{t) = Z(t)e~ So z (*) dx (7.7.6) 

EXAMPLE If f{t) = a/^-V 3 with a > and /3 > 0, the probability distribution 
function for a Weibull random variable, then the failure rate is Z(t) = afit 13 ' 1 and 
R(t) = e~ atfl . Note that failure rate decreases with time if j3 < 1 and increases with 
time if /3 > 1. 

7.7.4.1 Use of the exponential distribution 

If the hazard rate is a constant Z(f) = a (with a > 0) then f(f) = ae~ at (for t > 0) 
which is the probability density function for an exponential random variable. If a 
failed item is replaced with another having the same constant hazard rate a, then the 
sequence of occurrence of failures is a Poisson process. The constant 1/a is called 
the mean time between failures (MTBF). The reliability function is R(t) = e~ at . 
If a series system has n components, each with constant hazard rate {a{\, then 



R s (t)=exp[-Y,ai) ■ (7-7.7) 
The MTBF for the series system is [i s 



i=l 



If a parallel system has n components, each with identical constant hazard rate a, 
then the MTBF for the parallel system is fi p 

fh = -( 1 + l + --- + -)- (7.7.9) 
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7.8 RISK ANALYSIS AND DECISION RULES 



Suppose knowledge of a speci c state of a system is desired, and those states can be 
delineated as {#1, 62, ■ ■ . }. (In a weather application the states might be rain and no 
rain.) Decision rules are actions that may be taken based on the state of a system. 
For example, in making a decision about a trip, there are the decision rules: stay 
home, go with an umbrella, and go without an umbrella. 

A loss function is a function that depends on a speci c state and a decision rule. 
For example, consider the following loss function £(9, a): 

Loss function data 



Possible actions 


System state 
61 (rain) 62 (no rain) 


Stay home a\ 
Go without an umbrella ai 
Go with an umbrella 03 


4 4 

5 
2 5 



It is possible to determine the "best" decision, under different models, even without 
obtaining any data. 

1 . Minimax principle 

With this principle one should expect and prepare for the worst. That is, for 
each action it is possible to determine the minimum possible loss that may be 
incurred. This loss is assigned to each action; the action with the smallest (or 
minimum) maximum loss is the action chosen. 

For the given loss function data the maximum loss is 4 for action a \ and 5 for 
either of the actions 02 or 03 . Under a minimax principle, the chosen action 
would be ai and the minimax loss would be 4. 

2. Minimax principle for mixed actions 

It is possible to minimize the maximum loss when the action taken is a sta- 
tistical distribution, p, of actions. Assume that action a, is taken with proba- 
bility pi (with pi + p2 + p3 = 1). Then the expected loss L(9i) is given by 
L(6i) = E a [£(#,, a)] = pil(9i,ai) +P2£(0i, a 2 ) +p 3 £(0i,a 3 ). The given loss 
function data results in the following expected losses: 



L(02) 



Pi 



+ P2 



+ P3 



(7.8.1) 



It can be shown that the minimax point of this mixed action case has to sat- 
isfy L(8i) = £(#2)- Solving equation (7.8.1) with this constraint leads to 
5p2 = 3p3. Using this and pi + P2 + Pz = 1 in equation (7.8.1) results in 
L(6\ ) = L(02) = 4 — 7^3/5. This indicates that p 3 should be as large as 
possible. Hence, the maximum value is obtained by the mixed distribution 

„ = (0 3 5\ 



© 2003 by CRC Press LLC 



Hence, if action ai is chosen 3/8 's of the time, and action a% is chosen 5/8 's 
of the time, then the minimax loss is equal to L = 25/8. This is a smaller loss 
than using a pure strategy of only choosing a single action. 

3. Bayes actions 

If the probability distribution of the states {6\, 62, ■ ■ ■ } is given by the density 
function g(8i), then the loss has a known distribution with an expectation of 
B(a) = Ei[£(6i,a)] = g(8i)£(6i,a). This quantity is known as the Bayes 
loss for action a. A Bayes action is an action that minimizes the Bayes loss. 

For example, assuming that the prior distribution is given by g(8i) = 0.4 and 
g(0 2 ) = 0.6, then B( ai ) = 4, B(a 2 ) = 2, and B(a 3 ) = 3.8. This leads to the 
choice of action a 2 . 

A course of action can also be based on data about the states of interest. For 
example, a weather report Z will give data for the predictions of rain and no rain. 
Continuing the example, assume that the correctness of these predictions is given as 
follows: 





61 (rain) 62 (no rain) 


Predict rain z\ 
Predict no rain Z2 


0.8 0.1 
0.2 0.9 



That is, when it will rain, then the prediction is correct 80% of the time. 

A decision function is an assignment of data to actions. Since there are nitely 
many possible actions and nitely many possible values of Z, the number of decision 
functions is nite. For this example there are 3 2 = 9 possible decision functions, 
{d\ , d2 , ■ ■ ■ , dg }; they are de ned to be: 





Decision functions 


di c?2 ds di d$ de d-j d$ dg 


Predict z\ , take action 
Predict Z2 , take action 


a\ ci2 03 ai a-i ai ^3 «2 03 
a\ ci2 03 «2 ai C13 ai ^3 «2 



The risk function R(8, di) is the expected value of the loss when a speci c de- 
cision function is being used: R(9,di) = Ez[£(0, di(Z))\. It is straightforward to 
compute the risk function for all values of {d{\ and {aj}. This results in the follow- 
ing values: 



Risk function evaluation 


Decision Function 


Q\ (rain) # 2 


(no rain) 


di 


4 


4 


d 2 


5 





d 3 


2 


5 


di 


4.2 


0.4 


dh 


4.8 


3.6 


da 


3.6 


4.9 


d 7 


2.4 


4.1 


d 8 


4.4 


4.5 


dg 


2.6 


0.5 
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This array can now be treated as though it gave the loss function in a no-data 
problem. The minimax principle for mixed action results in the "best" solution being 
rule d 3 for p^'s °f tne time and rule d 9 for y| 's of the time. This leads to a minimax 
loss of • Before the data Z is received, the minimax loss was Hence, the data 
Z is "worth" ^ — || = i|| in using the minimax approach. 

The regret function (also called the opportunity loss function) r(9, a) is the loss, 
1(8, a), minus the minimum loss for the given 8: r(8, a) = 1(8, a) — min^ 1(8, b). 
For each state, the least loss is determined if that state were known to be true. This is 
the contribution to loss that even a good decision cannot avoid. The quantity r(8, a) 
represents the loss that could have been avoided had the state been known — hence 
the term regret. 

For the given loss function data, the minimum loss for 8 = 8\ is 2, and the 
minimum loss for 8 = 8-2 is 0. Hence, the regret function is 





8\ (rain) 


8-2 (no rain) 


a\ 


2 


4 


a-i 


3 





a-3 





5 



Most of the computations performed for a loss function could also be performed 
with the risk function. If the minimax principle is used to determine the "best" action, 
then, in this example, the "best" action is a 2 . 



7.9 STATISTICS 



7.9.1 DESCRIPTIVE STATISTICS 

1 . Sample distribution and density functions 
(a) Sample distribution function: 



1 " 

F(x) = - Vu(i-ij) (7.9.1) 
n 

%—\ 

where u(x) is the unit step function (or Heaviside function) de ne d by 
u(x) = for x < and u(x) = 1 for x > 0. 

(b) Sample density function or histogram: 

= -F(£o + (i + l)w) - F(x + iw) (7 9 2) 

w 

for x £ [xo + iw,xo + (i + l)w). The interval [x + iw, xq + (i + l)w) 
is called the i th bin, w is the bin width, and /, = F(xq + (i + l)w) — 
F(xq + iw) is the bin frequency. 
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2. Order statistics and quantiles: 

(a) Order statistics are obtained by arranging the sample values {x i , . . . , x n } 
in increasing order, denoted by 

X(i) < x {i ) <■■■< X(n)- (7.9.3) 

i. X(i) and X(„) are the minimum and maximum data values, respec- 
tively. 

ii. For i = 1, . . . , n, x^ is called the i th order statistic. 

(b) Quantiles: If < p < 1, then the quantile of order p, £ p , is de ned as 
the p(n + l) th order statistic. It may be necessary to interpolate between 
successive values. 

i. If p = j/4 for j = 1, 2, or 3, then £ j is called the j th quartile. 

4 

ii. If p = j/10 for j = 1, 2, . . . , 9, then £ j_ is called the j th decile. 

iii. If p = j/100 for j = 1,2,..., 99, then is called the j th 

100 

percentile. 



3. Measures of central tendency 
(a) Arithmetic mean: 



_ 1 ^ X\ + X-2 + ■ ■ ■ + X„ 

X = - > 



a:* = (7.9.4) 

n * — ' n 



(b) a-trimmed mean: 

n — k — l 

n(l - 2a) 



Xn = 'I - 2a) ( (1 " r) + + £ ) ' 



(7.9.5) 

where k = [an\ is the greatest integer less than or equal to an, and 
r = an — k. If a = then S a = ir. 

(c) Weighted mean: If to each Xi is associated a weight w, > so that 

n n 

Wj = 1, then z w = ^Wja;,. (7.9.6) 

i=l i=l 

(d) Geometric mean: 

G.M.= (j[x^J = ( Xl x 2 ■ ■ ■ x n )" . (7.9.7) 



© 2003 by CRC Press LLC 



(e) Harmonic mean: 

ILM.= -h— r= ■ r — r — -— r . (7.9.8) 

L^ti— 1 ajj £2 £ti 

(f) Relationship between arithmetic, geometric, and harmonic means: 

H.M. < G.M. < x (7.9.9) 

with equality holding only when all sample values are equal. 

(g) The mode is the data value that occurs with the greatest frequency. Note 
that the mode may not be unique. 

(h) Median: 

i. If n is odd and n = 2k + 1, then M = X( k+1 ) . 

ii. If n is even and n = 2k, then M = (x^) + X(k+i) ) /2- 

(i) Midrange: 

X(D + XCn 1 ! 

mid = w - w . (7.9.10) 

4. Measures of dispersion 

(a) Mean deviation or absolute deviation: 

^ n 1 n 

■D- = — |xj - af| , or A.D. = - V \ Xi - M\ . 



M.. 



n '■ — ' n 

i=l i=l 



(7.9.11) 



(b) Sample standard deviation: 



An — 1 y n — 1 



n 

(c) The sample variance is the square of the sample standard deviation. 



(d) Root mean square: R.M.S. 



\ 



1 " 
n ^ 

i=l 



(e) Sample range: X(„) — X(i). 

(f) Interquartile range: £3 —£1. 

4 4 

(g) The quartile deviation or semi-interquartile range is one half the interquar- 
tile range. 

5. Higher-order statistics 

1 " 

(a) Sample moments: mu = — > xf. 

n 

%—\ 

(b) Sample central moments, or sample moments about the mean: 

1 " 

-J2(xi-x) k . (7.9.13) 



n . 
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7.9.2 STATISTICAL ESTIMATORS 
7.9.2.1 De nitions 

1 . A function of a set of random variables is a statistic. It is a function of ob- 
servable random variables that does not contain any unknown parameters. A 
statistic is itself an observable random variable. 

2. Let 8 be a parameter appearing in the density function for the random variable 
X. Suppose that we know a formula for computing an approximate value 6 
of 6 from a given sample {x\, . . . ,x„} (call such a function g). Then 9 = 
g(xi,X2, ■ ■ ■ ,x n ) can be considered as a single observation of the random 
variable 6 = g(Xi , X 2 , . . . , X n ) . The random variable 6 is an estimator for 
the parameter 6. 

3. A hypothesis is an assumption about the distribution of a random variable X. 
This may usually be cast into the form 6 € 6<> We use H to denote the null 
hypothesis and Hi to denote an alternative hypothesis. 

4. In signi can ce testing, a test statistic T = T(X\, . . . ,X n ) is used to reject 
H , or to not reject H . Generally, if T € C, where C is a critical region, then 
H is rejected. 

5. A type I error, denoted a, is to reject H when it should not be rejected. A 
type II error, denoted [3, is to not reject H when it should be rejected. 

6. The power of a test is t] = 1 — /3. 





Unknown truth 


#0 


Hi 


Do not reject H 


True decision. 
Probability is 1 — a 


Type II error. 
Probability is j3 


Reject H 


Type I error. 
Probability is a 


True decision. 
Probability is t] = 1 — /3 



7.9.2.2 Consistent estimators 

Let = g(Xi,X2, ■ ■ ■ ,X n ) be an estimator for the parameter 8, and suppose 
that g is de ned for arbitrarily large values of n. If the estimator has the property, 
E[(6 — 9) 2 ] — > 0, as n — > oo, then the estimator is called a consistent estimator. 

1 . A consistent estimator is not unique. 

2. A consistent estimator may be meaningless. 

3. A consistent estimator is not necessarily unbiased. 
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7.9.2.3 Ef cient estimators 

An unbiased estimator 8 = g(Xi , X 2 , . . . , X n ) for a parameter 8 is said to be ef - 
cient if it has nite variance (E |^(0 — 0) 2 j < oo) and if there does not exist another 

estimator 6* = g*(Xi,X 2 , ■ ■ ■ ,X n ) for 8, whose variance is smaller than that of 
6. The efcien cy of an unbiased estimator is the ratio, 

Cramer-Rao lower bound 
Actual variance 

The relative efcien cy of two unbiased estimators is the ratio of their variances. 

7.9.2.4 Maximum likelihood estimators (MLE) 

Suppose X is a random variable whose density function is f{x\ 8), where 8 = {8\, 
8 r ). If the independent sample values obtained, then de ne the 

likelihood function as L = Y["-i f{ x i \ The MLE estimate for 8 is the solution of 
the simultaneous equations, ^ = 0, for i = 1, . . . , r. 

1 . A MLE need not be consistent. 

2. A MLE may not be unbiased. 

3. A MLE need not be unique. 

4. If a single suf cient statistic T exists for the parameter 8, the MLE of 8 must 
be a function of T. 

5. Let 6 be a MLE of 8. If r(-) is a function with a single-valued inverse, then a 
MLE ofr(0) isr(0). 

De ne x = ]T" = i X i/ n and s2 = £"=i ( X i ~ I n ( note that S ± s )- Then: 



Distribution 


Estimated 


MLE estimate 




parameter 


of parameter 


Exponential E(X) 


1/A 


l/x 


Exponential E(X) 


A 2 = a' 2 


x 2 


Normal N(fi, a) 




X 


Normal N(fi, a) 


a 2 


S 2 


Poisson P(X) 


X 


X 


Uniform [7(0, 8) 


8 





7.9.2.5 Method of moments (MOM) 

Let {Xi} be independent and identically distributed random variables with density 
f(x; 8). Let fi' r (8) = E[X r ] be the r th moment (if it exists). Let m' r = \ YTi=\ A 
be the r th sample moment. Form the k equations, n' r = m' r , and solve to obtain an 
estimate of 8. 

1 . MOM estimators are not necessarily uniquely de ned . 

2. MOM estimators may not be functions of suf cient or complete statistics. 
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7.9.2.6 Sufcient statistics 

A statistic G = g(Xi, . . . ,X n ) is called a sufcien t statistic if, and only if, the 
conditional distribution of H, given G, does not depend on 9 for any statistic H = 
h(Xi, . . . , X n ). 

Let {Xi} be independent and identically distributed random variables, with den- 
sity f(x; 6). The statistics {G\ , . . . , G r } are said to be jointly sufcien t statistics if, 
and only if, the conditional distribution of X i , X 2 , . . . , X n given G\ = g\,G\ = g 2 , 
. . . , G r = g r does not depend on 9. 

1 . A single suf cient statistic may not exist. 



7.9.2.7 UMVU estimators 

A uniformly minimum variance unbiased estimator, called a UMVU estimator, is 
unbiased and has the minimum variance among all unbiased estimators. 

De ne, as usual, x = ^7=1 ^i/n and s 2 = 5Z" =1 (-X"i — x) 2 /(n — 1). Then: 



Distribution 



Exponential E(X) 
Exponential E(X) 
Normal N(fj,,a) 
Normal N(fi, a) 
Poisson P(X) 
Uniform [7(0, 6) 



Estimated 
parameter 



A 

1 
A 



UMVU estimate 
of parameter 



n - 1 



x 

n + 1 



X„ 



n 



Variance of 
estimator 



n-2 
1 

nX 2 

n 
2a 4 
n — 1 
A 2 



n 



n(n + 2) 



7.9.2.8 Unbiased estimators 

An estimator g(Xi ,X 2 , ■ ■ ■ , X n ) for a parameter 6 is said to be unbiased if 



E[g(X u X 2 , 



(7.9.14) 



1 . An unbiased estimator may not exist. 

2. An unbiased estimator is not unique. 

3. An unbiased estimator may be meaningless. 

4. An unbiased estimator is not necessarily consistent. 
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7.9.3 CRAMER-RAO BOUND 



The Cramer-Rao bound gives a lower bound on the variance of an unknown un- 
biased statistical parameter, when n samples are taken. When the single unknown 
parameter is 9, 



a 2 (9) > 



1 



1 



-nE[^\ogf(x;9)] n E [(^ log 0)) : 



(7.9.15) 



EXAMPLES 

1. For a normal random variable with unknown mean 9 and known variance a 2 , the den- 
sity is f{x; 9) = 7=^exp(-^^). Hence, fglog f(x;9) = (x-9)/a 2 . The 



computation 



(x - ef 



r 



(x - 6f 



1 



-(x-0f/2a 2 



2-Kcr 



dx = — 



results in a 2 {6) > 

2. For a normal random variable with known mean fi and unknown variance 9 = d 2 , the 
density is f(x; 9) = 7=^ exp (- ^l!) . Hence, &log/(a;;fl) = ((x - fi) 2 - 

26) /{26) 2 . The computation E [ ( *~ ( ^)2~ 2<? ] = wi = ^pc results in a 2 {9) > 2a A jn. 

3. For a Poisson random variable with unknown mean 9, the density is f(x; 9) = ff'e -6 jx\. 
Hence, log f(x; 9) = x/9 — 1. The computation 

"(I - ol = £ (f - o a ^ = J resuits — 2 w > «/»• 



7.9.4 ORDER STATISTICS 

When {X{\ are n independent and identically distributed random variables with 
the common distribution function Fx(x), let Z m be the to* largest of the values 
(to = 1, 2, . . . , n). Hence Z\ is the maximum of the n values and Z n is the minimum 
of the n values. Then 

Fz m {x) = ("1 [Px(x)Y [1 - Fxix)]"-' . (7.9.16) 

i—m ^ ' 

Hence 

F mm (z) = [F x (z)] n , f m , x (z) =n[F x (z)] n - 1 f x (z), (7.9.17) 

F min (z) = 1-[1- F x (z)] n , f m Uz)=n[l-F x (z)] n - 1 fx(z). (7.9.18) 

The expected value of the i lh order statistic is given by 

E M = 7^TTi7 _ -v / xf(x)F t - 1 (x)[l-F(x)] n - t dx. (7.9.19) 
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7.9.4.1 Uniform distribution: 

If X is uniformly distributed on the interval [0,1) then 

E fod = 7— tw — ^ / xt 0- - x ) n ~ l dx - ( 7 - 9 - 2 °) 

- l)!(n - «)! i 

The expected value of the largest of n samples is ^-j-; the expected value of the least 
of n samples is ^q-p 

7.9.4.2 Normal distribution: 

The following table gives values of E \x(i)\ for a standard normal distribution. Miss- 
ing values (indicated by a dash) may be obtained from E \x(i)\ = — E [x( n _, :+ i)] . 



i 


n =2 


3 


4 


5 


6 


7 


8 


10 


1 


0.5642 


0.8463 


1.0294 


1.1630 


1.2672 


1.3522 


1.4236 


1.5388 


2 




0.0000 


0.2970 


0.4950 


0.6418 


0.7574 


0.8522 


1.0014 


3 








0.0000 


0.2016 


0.3527 


0.4728 


0.6561 


4 












0.0000 


0.1522 


0.3756 


5 
















0.1226 


6 



















EXAMPLE If a person of average intelligence takes ve intelligence tests (each test hav- 
ing a normal distribution with a mean of 100 and a standard deviation of 20), then the 
expected value of the largest score is 100 + (1.1630) (20) « 123. 



7.9.5 CLASSIC STATISTICS PROBLEMS 

7.9.5.1 Sample size problem 

Suppose that a Bernoulli random variable is to be estimated from a sample. What 
sample size n is required so that, with 99% certainty, the error is no more than e = 5 
percentage points (i.e., Prob(|p — p\ < 0.05) > 0.99)? 

If an a priori estimate of p is available, then the minimum sample size is n p = 
z^i 2 p(l —p)/e 2 . If no a priori estimate is available, thenn„ = <^ 2 /4e 2 > n p . For 
the numbers above, n >n n = 664. 

7.9.5.2 Large scale testing with infrequent success 

Suppose that a disease occurs in one person out of every 1000. Suppose that a test for 
this disease has a type I and a type II error of 1% (that is, a = ft = 0.01). Imagine 
that 100,000 people are tested. Of the 100 people who have the disease, 99 will be 
diagnosed as having it. Of the 99,900 people who do not have the disease, 999 will 
be diagnosed as having it. Hence, only j||g ?s 9% of the people who test positive 
for the disease actually have it. 
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7.1 CONFIDENCE INTERVALS 



A probability distribution may have one or more unknown parameters. A con dence 
interval is an assertion that an unknown parameter lies in a computed range, with a 
speci ed probability. Before constructing a con den ce interval, rst select a con - 
dence coef cien t, denoted 1 — a. Typically, 1 — a = 0.95, 0.99, or the like. The 
de nition s of z a , t a , and \ 2 a are in Section 7.14.1 on page 695. 



7.10.1 CONFIDENCE INTERVAL: SAMPLE FROM ONE 
POPULATION 

The following con d ence intervals assume a random sample of size n, given by 
{x 1 ,x 2 ,- ■ -,x n }. 

1 . Find mean fi of the normal distribution with known variance a 2 . 

(a) Determine the critical value z a i% such that $ (Za/2) = 1 — a l% where 
$ (z) is the standard normal distribution function. 

(b) Compute the mean x of the sample. 

(c) Computed = z a /2o/^Jn. 

(d) The 100(1— a) percent con dence interval for ji is given by [x — k, x + k]. 

2. Find mean fi of the normal distribution with unknown variance a 2 . 

(a) Determine the critical value t a / 2 such that F \t a /%) = 1 — ct/2, where 
jF(-) is the ^-distribution with n — 1 degrees of freedom. 

(b) Compute the mean x and standard deviation s of the sample. 

(c) Compute k = t a /2s/y/n. 

(d) The 100(1— a) percent con dence interval for yu is given by [x — k, x + k]. 

3. Find the probability of success p for Bernoulli trials with large sample size. 

(a) Determine the critical value z a / 2 such that $ { z a/2) = 1 — a l% where 
$ (z) is the standard normal distribution function. 

(b) Compute the proportion p of "successes" out of n trials. 



(d) The 100(1— a) percent con dence interval for pis given by [p — k,p + k\. 
4. Find variance a 2 of the normal distribution. 



1 — a/2 and F yXi- a /2j = a /2, where F (z) is the chi-square distri- 
bution function with n — 1 degrees of freedom, 
(b) Compute the standard deviation s. 
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(c) Compute k = z a /2 




(a) Determine the critical values X%/% an d Xi- a /2 sucn mat ^ [x^ 




(c) Compute k\ 



(n - l)s 2 



and k 2 



(n - l)s 2 



X-l-a/2 

(d) The 100(1 — a) percent con den ce interval for a 2 is given by [k\ , k 2 ]. 

(e) The 100(1 — a) percent con d ence interval for the standard deviation a 
is given by \\fk[, \fk~ 2 . 



5. Find quantile £ p of order p for large sample sizes. 

(a) Determine the critical value z a / 2 such that $ {z a / 2 ) = 1 — a/2, where 
$ (z) is the standard normal distribution function. 

(b) Compute the order statistics x(i) , X( 2 ) , ■ ■ ■ , X( n ) ■ 

(c) Compute k\ = ^np — z a / 2 y/np(l — p)J and 

k 2 = + ^/sV^l -p)] • 

(d) The 100(1— a) percent con dence interval for £ p is given by [x^) i ^(Aa)] ■ 

6. Find median M based on the Wilcoxon one-sample statistic for a large sample. 



(a) Determine the critical value z a / 2 such that $ {z a / 2 ) = 1 — a/2, where 
$ (z) is the standard normal distribution function. 

(b) Compute the order statistics W(!),W(2), . . . ,W(jv) of the AT = n(n — 1)/2 
averages (xj + Xj) /2, for 1 < i < j <n. 



(c) Compute k\ 



N 

y 



N 



3n 



and fco 



N 



3n 



(d) The 100(1— a) percent con dence interval for M is given by [w^) > w (fc 2 )] • 



7.10.2 CONFIDENCE INTERVAL: SAMPLES FROM TWO 
POPULATIONS 

The following con den ce intervals assume random samples from two large popula- 
tions: one sample of size n, given by {xi , x 2 , ■ ■ ■ , x n }, and one sample of size to, 
given by {yi,y 2 , ■■■ ,y m }- 

1. Find the difference in population means [i x and \i v from independent samples 
with known variances a 2 and a 2 . 

(a) Determine the critical value z a / 2 such that $ ( z a/2) = 1 — a/2, where 
$ (z) is the standard normal distribution function. 

(b) Compute the means x and y. 



(c) Compute k = z a / 2 \ — + — . 

' V n to 

(d) The 100(1 — a) percent con d ence interval for fi x — fi y is given by 
[(x-y) -k,(x-y) + k]. 
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2. Find the difference in population means \i x and fi y from independent samples 
with unknown variances a\ and a y . 

(a) Determine the critical value z a / 2 such that $ (z a / 2 ) = 1 — a/2, where 
$ (z) is the standard normal distribution function. 

(b) Compute the means x and y, and the standard deviations s x and s y . 

(c) Compute k = z a / 2 \ — + — ■ 

' V n m 

(d) The 100(1 — a) percent con d ence interval for fi x — fi y is given by 
[(x-y) -k,(x-y) + k]. 



3. Find the difference in population means fi x and fi y from independent samples 
with unknown but equal variances a\ = a y . 

(a) Determine the critical value t a / 2 such that F (t a / 2 ) = 1 — a/2, where 
F(-) is the i-distribution with n + m — 2 degrees of freedom. 

(b) Compute the means afand y, the standard deviations s x and s y , and the 
pooled standard deviation estimate, 



' (n — l)sl + (m — l)s2 

71 + 771 — 2 



(7.10.1) 



(c) Compute k = t a / 2 s \ — + — . 

' V 71 771 

(d) The 100(1 — a) percent con d ence interval for [i x — [i y is given by 
[(x-y) - k,(x-y) +k]. 



4. Find the difference in population means fi x and n y for paired samples with 
unknown but equal variances a x = a y . 

(a) Determine the critical value t a / 2 such that F (ta/2) = 1 — a/2, where 
F(-) is the i-distribution with n — 1 degrees of freedom. 

(b) Compute the mean p,^ and standard deviation S4 of the paired differences 
x\ - yi,x 2 - 2/2, ■ ■ ■ ,x n - y n . 

(c) Compute k = t a / 2 Sd/^/n. 

(d) The 100(1 — a) percent con d ence interval for [i^ = [i x — [i y is given 
by [p, d -k,Ji d + k]. 



5. Find the difference in Bernoulli trial success rates, p x —p y , for large, indepen- 
dent samples. 

(a) Determine the critical value z a / 2 such that $ (z a / 2 ) = 1 — a/2, where 
$ (z) is the standard normal distribution function. 

(b) Compute the proportions p x and p y of "successes" for the samples. 

, x n t , /Px (1 - Pa;) , Py 0- ~ Py) 

(c) Compute k = z a / 2 \ 1 — — . 

' V n m 
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(d) The 100(1 — a) percent con den ce interval for p x — p y is given by 
[(px ~ P y ) - k, (p x - p y ) + k]. 



6. Find the difference in medians M x —M y based on the Mann-Whitney-Wilcoxon 
procedure. 

(a) Determine the critical value z a / 2 such that $ {z a / 2 ) = 1 — ot/2, where 
$ (z) is the standard normal distribution function. 

(b) Compute the order statistics , W( 2 ) , . . . , W(jv) of the iV = nm differ- 
ences Xi — yj, for 1 < i < n and 1 < j < m. 

(c) Compute 



I VI I V 

ki = — + 



0.5 



z a/2 



nm (n + m + 1) 
12 



and 



nm „ „ Inm (n + m + 1) 
— -0.5 + z a/2 V— ^ 



(d) The 100(1 — a) percent con de nee interval for M x — M y is given by 

[w (kl) ,w (k2) ]. 



7. Find the ratio of variances a x /a^, for independent samples. 

(a) Determine the critical values F a j 2 and F 1 _ a / 2 such that F (F a / 2 ) = 
1 - a/2 and F (i 7, i_ Q ,/ 2 ) = a/2, where F(-) is the F-distribution with 
to — 1 and n — 1 degrees of freedom. 

(b) Compute the standard deviations Sj and s y of the samples. 

(c) Compute k\ = F 1 _ a / 2 and k 2 = F a / 2 . 

(d) The 100(1 — a) percent con den ce interval for o x /Oy is given by 

s 2 s 2 
-ffci,-ffc 2 



7.1 1 TESTS OF HYPOTHESES 

A statistical hypothesis is a statement about the distribution of a random variable. 
A statistical test of a hypothesis is a procedure in which a sample is used to deter- 
mine whether we should "reject" or "not reject" the hypothesis. Before employing a 
hypothesis test, rst select a signi c ance level a. Typically, a = 0.05, 0.01, or the 
like. 
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7.1 1 .1 HYPOTHESIS TESTS: PARAMETER FROM ONE 
POPULATION 

The following hypothesis tests assume a random sample of size n, given by {x \ , x 2 , ■ ■ 

1 . Test of the hypothesis /x = /xo against the alternative fi ^ no of the mean of a 
normal distribution with known variance a 2 : 

(a) Determine the critical value z a / 2 such that $ ( z a/2) = 1 — <*/2, where 
$ (z) is the standard normal distribution function. 

(b) Compute the mean x of the sample. 

, „ _ , . . (x — uq) \/n 

(c) Compute the test statistic z = . 

a 

(d) If \z\ > z a /2, then reject the hypothesis. If \z\ < z a / 2 , then do not reject 
the hypothesis. 



2. Test of the hypothesis /j = /j against the alternative n > /i (or n < /i ) of 
the mean of a normal distribution with known variance a 2 : 

(a) Determine the critical value z a such that $ (z a ) = 1 — a, where $ (z) is 
the standard normal distribution function. 

(b) Compute the mean x of the sample. 

, • • (x — llq) \/n _ , , 

(c) Compute the test statistic z = . (For the alternative [i < [i , 

a 

multiply z by —1.) 

(d) If z > z a , then reject the hypothesis. If z < z a , then do not reject the 
hypothesis. 



3. Test of the hypothesis fi = /i against the alternative ji ^ fi of the mean of a 
normal distribution with unknown variance a 2 : 

(a) Determine the critical value t a / 2 such that F (t a / 2 ) = 1 — a/2, where 
F(-) is the i-distribution with n — 1 degrees of freedom. 

(b) Compute the mean x and standard deviation s of the sample. 

, , ^ , • • (x — Un) \/n 

(c) Compute the test statistic t = . 

s 

(d) If \t\ > t a /2, then reject the hypothesis. If \t\ < t a / 2 , then do not reject 
the hypothesis. 



4. Test of the hypothesis /j = /j against the alternative n > /i (or /i < /i ) of 
the mean of a normal distribution with unknown variance a 2 : 

(a) Determine the critical value t a such that F (t a ) = 1 — a, where F(-) is 
the i-distribution with n — 1 degrees of freedom. 

(b) Compute the mean x and standard deviation s of the sample. 

(c) Compute the test statistic t = — — (For the alternative < fio, 

s 

multiply t by — 1.) 
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(d) If t > t a , then reject the hypothesis. If t < t a , then do not reject the 
hypothesis. 



5. Test of the hypothesis p = p against the alternative p ^ p of the probability 
of success for a binomial distribution, large sample: 

(a) Determine the critical value z a /2 such that $ (za/2) = 1 — <*/2, where 
$ (z) is the standard normal distribution function. 

(b) Compute the proportion p of "successes" for the sample. 

(c) Compute the test statistic z = — ^ P ° . 

/ Po(l-Po) 

(d) If \z\ > z a /2, then reject the hypothesis. If \z\ < z a / 2 , then do not reject 
the hypothesis. 



6. Test of the hypothesis p = p against the alternative p > p (ovp < p ) of the 
probability of success for a binomial distribution, large sample: 

(a) Determine the critical value z a such that $ (z a ) = 1 — a, where $ (z) is 
the standard normal distribution function. 

(b) Compute the proportion p of "successes" for the sample. 

(c) Compute the test statistic z = — P P° _ (p or alternative p < p , 

/ Po(l-Po) 
V n 

multiply z by — 1.) 

(d) If z > z a , then reject the hypothesis. If z < z a , then do not reject the 
hypothesis. 



7. Wilcoxon signed rank test of the hypothesis M = Mq against the alternative 
M ^ Mo of the median of a population, large sample: 

(a) Determine the critical value z a /2 such that $ (za/2) = 1 — a/2, where 
$ (z) is the standard normal distribution. 

(b) Compute the quantities \xi — Mq\, and keep track of the sign of X{ — Mo- 
If \xi — Mo I = 0, then remove it from the list and reduce n by one. 

(c) Order the \xi — M \ from smallest to largest, assigning rank 1 to the 
smallest and rank n to the largest; \xi — Mq\ has rank r, if it is the rf 
entry in the ordered list. In case of ties (i.e., \xi — M \ = \xj — M \ for 
2 or more values) assign each the average of their ranks. 

n 

(d) Compute the sum of the signed ranks R = ^ sign (xi — M ) ti. 

i=l 

(e) Compute the test statistic z = — . 

/ «(«+lK2«+l) 

(f) If \z\ > z a /2, then reject the hypothesis. If \z\ < z a / 2 , then do not reject 
the hypothesis. 
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8. Wilcoxon signed rank test of the hypothesis M = Mo against the alternative 
M > Mo (or M < Mo) of the median of a population, large sample: 

(a) Determine the critical value z a such that $ (z a ) = 1 — a, where $ (z) is 
the standard normal distribution. 

(b) Compute the quantities \xi — Mq\, and keep track of the sign of X{ — Mo- 
If \xi — Mo | = 0, then remove it from the list and reduce n by one. 

(c) Order the \xi — M | from smallest to largest, assigning rank 1 to the 
smallest and rank n to the largest; \xi — Mq\ has rank r, if it is the rf 
entry in the ordered list. If \xi — M | = \xj — M |, then assign each the 
average of their ranks. 

n 

(d) Compute the sum of the signed ranks R = ^ sign (xi — M ) r,. 

i=l 

(e) Compute the test statistic z = — . (For the alternative 

l)(2n+l) 



6 

M < M , multiply the test statistic by -1.) 
(f) If z > z a , then reject the hypothesis. If z < z a , then do not reject the 
hypothesis. 

9. Test of the hypothesis a 2 = a\ against the alternative a 2 ^ a\ of the variance 
of a normal distribution: 

(a) Determine the critical values Xa/2 anc * Xi- a /2 suc ^ mat ^ (^a/2) = 

1 — a/2 and F (xi-a/2) = a /^> wnere ^(0 i s m e chi-square distribu- 
tion function with n — 1 degrees of freedom. 

(b) Compute the standard deviation s of the sample. 

, . . n in - l)s 2 

(c) Compute the test statistic x = 2 • 



<7, 







(d) If x < Xi-a/2 or X > X a /2' then re J ect the hypothesis 

y /2 — X < X a / 



(e) If Xi-a/2 — X 2 < Xa/2' men ^° not re j ect me hypothesis. 



10. Test of the hypothesis a 2 = a\ against the alternative a 2 > a\ (or a 2 < (Tq) 
of the variance of a normal distribution: 

(a) Determine the critical value x a (xl- a f° r me alternative a 2 < a 2 ) such 
that F (x a ) = 1 - a (F (xl- a ) = a )' where F(-) is the chi-square 
distribution function with n — 1 degrees of freedom. 

(b) Compute the standard deviation s of the sample. 

2 _ (" " I)* 2 



(c) Compute the test statistic x 

(d) If x 2 > Xa (X 2 < X1-0)' men re j ec t the hypothesis. 

(e) If x 2 < X a (Xi-a ^ X 2 )' then do not reject the hypothesis. 
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7.1 1 .2 HYPOTHESIS TESTS: PARAMETERS FROM TWO 
POPULATIONS 

The following hypothesis tests assume a random sample of size n, given by {x \ , x 2 , ■ ■ 
x n } , and a random sample of size to, given by {y i , y 2 , . . . , y m } . 

1. Test of the hypothesis [i x = /j, y against the alternative [i x ^ [i y of the means 
of independent normal distributions with known variances a \ and a y : 

(a) Determine the critical value z a / 2 such that $ (z a / 2 ) = 1 — «/2, where 
$ (z) is the standard normal distribution function. 

(b) Compute the means, x and y, of the samples. 

, • • x — y 

(c) Compute the test statistic z = — . 

J& + £ 

V n m 

(d) If |z| > z a /2> then reject the hypothesis. If \z\ < z a / 2 , then do not reject 
the hypothesis. 



2. Test of the hypothesis /i x = /i y against the alternative /i x > /i y (or /i x < 
of the means of independent normal distributions with known variances a \ 
and o y : 

(a) Determine the critical value z a such that $ (z a ) = 1 — a, where $ (z) is 
the standard normal distribution function. 

(b) Compute the means x and y of the samples. 

~x — ~y 

(c) Compute the test statistic z = — . (For the alternative fi x < fi y , 

V n m 

multiply z by — 1.) 

(d) If 2; > then reject the hypothesis. If z < z a , then do not reject the 
hypothesis. 



3. Test of the hypothesis /i x = n y against the alternative fi x ^ fi y of the means 
of independent normal distributions with unknown variances a x and a y , large 
sample: 

(a) Determine the critical value z a / 2 such that $ ( z a/2) = 1 — «/2, where 
$ (z) is the standard normal distribution. 

(b) Compute the means, x and y, and standard deviations, s \ and s y , of the 
samples. 

x-y 



(c) Compute the test statistic z 



>x 1 y 
n m 



(d) If \z\ > z a / 2 , then reject the hypothesis. li\z\ < z a / 2 , then do not reject 
the hypothesis. 



4. Test of the hypothesis /i x = n y against the alternative \i x > n y (or fi x < fi y ) 
of the means of independent normal distributions with unknown variances, a x 
and a y , large sample: 
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(a) Determine the critical value z a such that $ (z a ) = 1 — a, where $ (z) is 
the standard normal distribution function. 

(b) Compute the means, x and y, and standard deviations, s \ and s y , of the 
samples. 

x~ — y 

(c) Compute the test statistic z = — . (For the alternative fi x < /i y , 

V n m 

multiply z by — 1.) 

(d) If z > z a , then reject the hypothesis. If z < z a , then do not reject the 
hypothesis. 



5. Test of the hypothesis ji x = n y against the alternative ji x ^ n y of the means 
of independent normal distributions with unknown variances a x = a y : 

(a) Determine the critical value t a / 2 such that F (t a / 2 ) = 1 — ct/2, where 
F(-) is the i-distribution with n + m — 2 degrees of freedom. 

(b) Compute the means, x and y, and standard deviations, s \ and s y , of the 
samples. 

~x — y 

(c) Compute the test statistic t = — , — ■ 

V n+m — 2 \j n m 

(d) If \t\ > t a /2, then reject the hypothesis. If \t\ < t a / 2 , then do not reject 
the hypothesis. 



6. Test of the hypothesis \i x = n y against the alternative \i x > n y (or \i x < 
li y ) of the means of independent normal distributions with unknown variances 

a\ = (J 2 y : 

(a) Determine the critical value t a such that F (t a ) = 1 — a, where F(-) is 
the i-distribution with n + m — 2 degrees of freedom. 

(b) Compute the means, x and y, and standard deviations, s \ and s y , of the 
samples. 

~x — y 

(c) Compute the test statistic t = — , — ■ (For the 

/ («-i)^+(m-T)7f h + ± 

V n+m— 2 y n m 

alternative fi x < n y , multiply t by — 1.) 

(d) If t > t a , then reject the hypothesis. If t < t a , then do not reject the 
hypothesis. 



7. Test of the hypothesis fi x = /i y against the alternative fi x ^ fi y of the means 
of paired normal samples: 

(a) Determine the critical value t a / 2 so that F (t a / 2 ) = 1 — a/2, where F(-) 
is the i-distribution with n — 1 degrees of freedom. 

(b) Compute the mean, £14, and standard deviation, s,i, of the differences 

x\-y\,x 2 -y 2 ,...,x n -y n . 

(c) Compute the test statistic t = ^ rfv ^ . 

Sd 
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(d) If \t\ > t a /2, then reject the hypothesis. If \t\ < t a / 2 , then do not reject 
the hypothesis. 



8. Test of the hypothesis fi x = n y against the alternative fi x > n y (or fi x < fi y ) 
of the means of paired normal samples: 

(a) Determine the critical value t a so that F (t a ) = 1 — a, where F(-) is the 
i-distribution with n — 1 degrees of freedom. 

(b) Compute the mean, fid, and standard deviation, Sd, of the differences 
x\ - yi,x 2 - i/2, ■ ■ ■ ,x n - y n . 

(c) Compute the test statistic t = , (For the alternative a x < n v , 

Sd 

multiply t by — 1.) 

(d) If t > t a , then reject the hypothesis. If t < t a , then do not reject the 
hypothesis. 



9. Test of the hypothesis p x = p y against the alternative p x ^ p y of the proba- 
bility of success for a binomial distribution, large sample: 

(a) Determine the critical value z a / 2 such that $ (z a /2) = 1 — a/2, where 

(z) is the standard normal distribution function. 

(b) Compute the proportions, p x and p y , of "successes" for the samples. 

(c) Compute the test statistic z = — P x Py _ 

\ n m 

(d) If \z\ > z a /2, then reject the hypothesis. If | ^ | < z a / 2 , then do not reject 
the hypothesis. 



10. Test of the hypothesis p x = p y against the alternative p x > p y (01 p x < p y ) of 
the probability of success for a binomial distribution, large sample: 

(a) Determine the critical value z a such that $ (z a ) = 1 — a, where $ (z) is 
the standard normal distribution function. 

(b) Compute the proportions, p x and p y , of "successes" for the samples. 

Px ~ Pv 

(c) Compute the test statistic z = = . (Multiply it by 

/ fe(i-fe) , A/(i-p») 

\ n m 

— 1 for the alternative p x < p y .) 

(d) If z > z a , then reject the hypothesis. If z < z a , then do not reject the 
hypothesis. 



1 1 . Mann-Whitney-Wilcoxon test of the hypothesis M x = M y against the alter- 
native M x ^ M y of the medians of independent samples, large sample: 

(a) Determine the critical value z a / 2 such that $ (za/2) = 1 — a/2, where 

(z) is the standard normal distribution. 

(b) Pool the N = m + n observations, but keep track of which sample the 
observation was drawn from. 
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(c) Order the pooled observations from smallest to largest, assigning rank 1 
to the smallest and rank N to the largest; an observation has rank r , if 
it is the rf entry in the ordered list. If two observations are equal, then 
assign each the average of their ranks. 

(d) Compute the sum of the ranks from the rst sample T x . 

j, _ m(N+l) 

(e) Compute the test statistic z = — 2 -. 



(f) If \z\ > z a /2, then reject the hypothesis. If \z\ < z a / 2 , then do not reject 
the hypothesis. 



12. Mann-Whitney-Wilcoxon test of the hypothesis M x = M y against the alter- 
native M x > My (or M x < My) of the medians of independent samples, large 
sample: 

(a) Determine the critical value z a such that $ (z a ) = 1 — a, where $ (z) is 
the standard normal distribution. 

(b) Pool the N = m + n observations, but keep track of which sample the 
observation was drawn from. 

(c) Order the pooled observations from smallest to largest, assigning rank 1 
to the smallest and rank N to the largest; an observation has rank r , if 
it is the rf entry in the ordered list. If two observations are equal, then 
assign each the average of their ranks. 

(d) Compute the sum of the ranks from the rst sample T x . 

rp _ m(jV+l) 

(e) Compute the test statistic z = - ^ =-. (For the alternative M x < 

/ mn(JV+l) 
V 12 

My, multiply the test statistic by —1.) 

(f) If \z\ > z a , then reject the hypothesis. If \z\ < z a , then do not reject the 
hypothesis. 



13. Wilcoxon signed rank test of the hypothesis M x = M y against the alternative 
M x ^ My of the medians of paired samples, large sample: 

(a) Determine the critical value z a /2 such that $ (za/2) = 1 — <*/2, where 
$ (z) is the standard normal distribution. 

(b) Compute the paired differences = Xi — yt, for i = 1,2, ... ,n. 

(c) Compute the quantities \di\ and keep track of the sign of d{. If = 0, 
then remove it from the list and reduce n by one. 

(d) Order the from smallest to largest, assigning rank 1 to the smallest 
and rank n to the largest; \di \ has rank r, if it is the rf entry in the ordered 
list. In case of ties (i.e., |d, | = \dj \ for 2 or more values) assign each the 
average of their ranks. 

n 

(e) Compute the sum of the signed ranks R = ^ sign (d,) r,. 

i=l 

R 

(f) Compute the test statistic z = — , . 

/ «(«+lK2«+l) 
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(g) If \z\ > z a /2, then reject the hypothesis. If \z\ < z a / 2 , then do not reject 
the hypothesis. 



14. Wilcoxon signed rank test of the hypothesis M x = M y against the alternative 
M x > My (or M x < My) of the medians of paired samples, large sample: 

(a) Determine the critical value z a such that $ (z a ) = 1 — a, where $ (z) is 
the standard normal distribution. 

(b) Compute the paired differences di = X{ — yi, for i = 1,2, . . . ,n. 

(c) Compute the quantities \di\ and keep track of the sign of d{. If di = 0, 
then remove it from the list and reduce n by one. 

(d) Order the \di\ from smallest to largest, assigning rank 1 to the smallest 
and rank n to the largest; \di | has rank r, if it is the rf entry in the ordered 
list. In case of ties (i.e., \di \ = \dj \ for 2 or more values) assign each the 
average of their ranks. 

n 

(e) Compute the sum of the signed ranks R = ^ sign (di) Ti. 

R 

(f) Compute the test statistic z = — , . (For the alternative 

/ n(n+l)(2n+l) 

M x < My, multiply the test statistic by —1.) 

(g) If z > z a , then reject the hypothesis. If z < z a , then do not reject the 
hypothesis. 



15. Test of the hypothesis a\ = Oy against the alternative a x ^ a y (or a x > Oy) 
of the variances of independent normal samples: 

(a) Determine the critical value F a / 2 (F a for the alternative a x > <7y) such 
that F (F a/2 ) = 1 - a/2 (F (F a ) = 1 - a), where F(-) is the F- 
distribution function with n — 1 and to — 1 degrees of freedom. 

(b) Compute the standard deviations s x and s y of the samples. 

s 2 

(c) Compute the test statistic F = -|. (For the two-sided test, put the larger 

S y 

value in the numerator.) 

(d) If F > F a/2 (F > F a ), then reject the hypothesis. If F < F a/2 (F < 
F a ), then do not reject the hypothesis. 



7.1 1 .3 HYPOTHESIS TESTS: DISTRIBUTION OF A 
POPULATION 

The following hypothesis tests assume a random sample of size n, given by 
{x 1 ,x 2 , . . .,x n }. 

1. Run test for randomness of a sample of binary values, large sample: 
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(a) Determine the critical value z a / 2 such that $ (za/2) = 1 — <*/2, where 
$ (z) is the standard normal distribution function. 

(b) Since the data are binary, denote the possible values of a;, by and 1. 
Count the total number of zeros, and call this n 1 ; count the total number 
of ones, and call this n 2 - Group the data into maximal sub-sequences of 
consecutive zeros and ones, and call each such sub-sequence a run. Let 
R be the number of runs in the sample. 

(c) Compute m = + l, and a\ = <"*-?<£*^ ■ 

Tli + n-2 ni-t-n 2 ± 

• • R — ur 

(d) Compute the test statistic z = . 

or 

(e) If \z\ > z a /2, then reject the hypothesis. If \z\ < z a / 2 , then do not reject 
the hypothesis. 

2. Run test for randomness against an alternative that a trend is present in a sam- 
ple of binary values, large sample: 

(a) Determine the critical value z a such that $ (z a ) = 1 — a, where $ (z) is 
the standard normal distribution function. 

(b) Since the data are binary, denote the possible values of a;, by and 1. 
Count the total number of zeros, and call this n 1 ; count the total number 
of ones, and call this n 2 . Group the data into maximal sub-sequences of 
consecutive zeros and ones, and call each such sub-sequence a run. Let 
R be the number of runs in the sample. 

2ti\ti 2 

rii + n-2 

• • R — ur 

(d) Compute the test statistic z = . 

or 

(e) If z < —z a , then reject the hypothesis (this suggests the presence of a 
trend in the data). If z > —z a , then do not reject the hypothesis. 

3. Run test for randomness against an alternative that the data are periodic for a 
sample of binary values, large sample: 

(a) Determine the critical value z a such that $ (z a ) = 1 — a, where $ (z) is 
the standard normal distribution function. 

(b) Since the data are binary, denote the possible values of a;, by and 1. 
Count the total number of zeros, and call this n 1 ; count the total number 
of ones, and call this ri2- Group the data into maximal sub-sequences of 
consecutive zeros and ones, and call each such sub-sequence a run. Let 
R be the number of runs in the sample. 

(c) Compute m = + 1, and a\ = ■ 

• • R — ur 

(d) Compute the test statistic z = . 

or 

(e) If z > z a , then reject the hypothesis (this suggests the data are periodic). 
If z < z a , then do not reject the hypothesis. 



(c) Compute „ R = + 1, and o\ = ( "*-?<£*^ ■ 
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4. Chi-square test that the data are drawn from a speci c & -parameter multino- 
mial distribution, large sample: 

(a) Determine the critical value x a sucn mat F (xV) = 1 — a, where F(x) 
is the chi-square distribution with k — 1 degrees of freedom. 

(b) The fc -parameter multinomial has k possible outcomes A\, A 2 , . . . , Ak 
with probabilities pi,p 2 , . . . ,Pk- For i = 1,2,. . . ,k, compute m, the 
number of xj 's corresponding to Ai . 

(c) For i = 1,2, ... ,k, compute the sample multinomial parameters pi = 
rii/n. 

(d) Compute the test statistic x =7 — 

ti 

(e) If x 2 > Xa' m en reject the hypothesis. If x 2 < X«> m en do not reject 
the hypothesis. 



5. Chi-square test for independence of attributes A and B having possible out- 
comes Ai , A 2 , . . . , A k and Si , B 2 , . . . , B m : 

(a) Determine the critical value x 2 a sucn m at F (xV) = 1 — a, where F(-) 
is the chi-square distribution with (k — l)(m — 1) degrees of freedom. 

(b) For i = 1,2, ... ,k and j = 1, 2, . . . , m, de ne Oy to be the number of 
observations having attributes Ai and Bj, and de ne o,. = Yl'JLi °*i an ^ 

i=l °ir 

(c) The variables de ned above are often collected into a table, called a con- 
tingency table: 



Attribute 


Bi 


B 2 ■ 


B m 


Totals 


A 1 


on 


Oil ■ 


0\m 


Ol. 


A 2 


021 


022 ' 


o 2m 


2 • 


A k 


0*1 


Ofc2 • 


Okm 


Ok- 


Totals 


0.1 


0.2 • 


■ o. m 


n 



(d) For i = 1,2, ... ,k and j = 1,2, ... ,m, compute the sample mean num- 
ber of observations in the ij th cell of the contingency table 



km, n2 

(e) Compute the test statistic, X 2 = <hlL_ 

i=i j=i 6y 

(f) Ifx 2 > Xa' men reject the hypothesis (that is, conclude that the attributes 
are not independent). If x 2 < X a > men do not reject the hypothesis. 



6. Kolmogorov-Smirnov test that F (x) is the distribution of the population from 
which the sample was drawn: 

(a) Determine the critical value D a such that Q(D a ) = 1 — a, where Q(D) 
is the distribution function for the Kolmogorov-Smirnov test statistic D. 
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(b) Compute the sample distribution function F(x). 

(c) Compute the test statistic, given the maximum deviation of the sample 
and target distribution functions D = max F(x) — F (x) . 

(d) If D > D a , then reject the hypothesis (that is, conclude that the data are 
not drawn from F (x)). If D < D a , then do not reject the hypothesis. 



7.1 1 .4 HYPOTHESIS TESTS: DISTRIBUTIONS OF TWO 
POPULATIONS 

The following hypothesis tests assume a random sample of size n, given by 
{xi }, and a random sample of size to, given by {y i , yi , . . . , y m }. 

1 . Chi-square test that two ^-parameter multinomial distributions are equal, large 
sample: 

(a) Determine the critical value x 2 a such that F (x 2 a ) = I - a, where F(-) 
is the chi-square distribution with k — 1 degrees of freedom. 

(b) The fc-parameter multinomials have k possible outcomes A i , A 2 , 
Af.. For i = 1,2, ... ,k, compute n,, the number of xf & corresponding 
to Ai, and compute nii, the number of yj 's corresponding to Ai. 

(c) For i = 1,2, ... ,k, compute the sample multinomial parameters = 

n + m 

(d) Compute the test statistic, 

2 = ( n i - n Pi) 2 , y^ (mi- mpj) 2 (7 111) 

■~ npi 4^ tnpi 

(e) If x 2 > Xa> m en reject the hypothesis. If x 2 < Xa> m en do not reject 
the hypothesis. 

2. Mann- Whitney- Wilcoxon test for equality of independent continuous distri- 
butions, large sample: 

(a) Determine the critical value z a /2 such that $ (za/2) = 1 — a/2, where 
$ (z) is the normal distribution function. 

(b) For i = 1,2,. . . ,n and j = 1, 2, . . . , to, de ne Sij = 1 if Xi < yj and 
Sij = if Xi > yj. 



n m 

C ij- 



(c) Compute U = ^ ^ S, 

i=i 3=1 

jj mn 

(d) Compute the test statistic z — ■- — 



/ mn(m+n+l) 
V 12 

(e) If \z\ > z a /2, then reject the hypothesis. lf\z\ < z a / 2 , then do not reject 
the hypothesis. 



© 2003 by CRC Press LLC 



3. Spearman rank correlation coefcient for independence of paired samples, 
large sample: 

(a) Determine the critical value R a /2 such that F (R a /2) = 1 — a/2, where 
F (R) is the distribution function for the Spearman rank correlation co- 
ef cient. 

(b) The samples are ordered, with the smallest X{ assigned the rank r\ and 
the largest assigned the rank r n ; for i = 1, 2, . . . , n, Xi is assigned rank 
r, if it occupies the i th position in the ordered list. Similarly the j/^'s are 
assigned ranks s , . In case of a tie within a sample, the ranks are averaged. 

(c) Compute the test statistic 




(d) If \R\ > R a /2, then reject the hypothesis. If \R\ < R a / 2 , then do not 
reject the hypothesis. 



7.1 1 .5 SEQUENTIAL PROBABILITY RATIO TESTS 

Given two simple hypotheses and m observations, compute: 

1- Pom = Prob (observations | Ho). 

2- Pim = Prob (observations | Hi). 

3- V m = Plm/Pom- 

Then make one of the following decisions: 

1 . If v m > - — — then reject H . 

a 

2. If v m < then reject Hi . 

1 — a 

3. If — — — < v m < - — — then make another observation. 

1 — a a 

Hence, the number of samples taken is not x ed a priori, but determined as sampling 
occurs. 

EXAMPLES 

1. Let 8 denote the fraction of defective items. Two simple hypotheses are H : 6 = Oo = 
0.05 and Hi: 8 = 6i = 0.15. Choose a = 5% and j3 = 10% (i.e., reject lot with 
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8 = 8o about 5% of the time; accept lot with 8 = 81 about 10% of the time). If, after 
m observations, there are d defective items, then 

P,„ - (-)<?(! - *)- _ „„ . (I)' <7.„.2> 

or w m = 3 d (0.895) m_<:! , using the above numbers. The critical values are yr^- = 
0.105 and = 18. The decision to perform another observation depends on whether 
or not 

0.105 < 3 d (0.895) m ~ d < 18. (7.11.3) 

Taking logarithms, a (m — d, d) control chart can be drawn with the following lines: 
d = 0.101(m - d) - 2.049 and d = 0.101(m - d) + 2.63. On the gure below, a 
sample path leading to rejection of H has been indicated: 




n — d (non-defectives) 



Let X be normally distributed with unknown mean [i and known standard deviation a. 
Consider the two simple hypotheses, Ho : [i = and H\ : [i = [i\ . If Y is the sum 
of the rst m observations of X, then a (Y, m) control chart is constructed with the 
two lines: 

-m H log ■ 



2 /ii-/i 1-a (?114) 

Ato+A*i . <7 2 , 1-/3 

Y = : - — Tr—rri H log . 

2 in — Ho a 



7.12 LINEAR REGRESSION 

1. The general linear statistical model assumes that the observed data values 
{yi,V2, ■ ■ -,y m } are of the form 

Ui= Po+ Pixa + P 2 Xi2 H h y8„x in + e,, 

fori = 1,2, 



■ ■ ■ f 1 
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2. For i = 1,2, ... , to and j = 1, 2, . . . , n, the independent variables x are 
known (nonrandom). 

3. {/?o, A , /?2, • • • , P n } are unknown parameters. 

4. For each i, e, is a zero-mean normal random variable with unknown vari- 
ance a 2 . 



IMA LINEAR MODEL Vi = fi + fai + e 

1 . Point estimate of fi\ : 

m / m \ / m \ 

m ^2 Xiyi - I ^ Xi J I Vi 

a «=1 V«=l / V«=l / 



2. Point estimate of /? : 

Po = y- P\x- 

3. Point estimate of the correlation coef c ient: 



TO 



£^- E^ E^ 



r = p 



i=l 



«.i=l / \i=l 



5>? - £= 



\«=1 



1 



4. Point estimate of error variance (T 2 : ct 2 = 



m-2 

5. The standard error of the estimate is de ned as s e = V^cr 2 ". 

6. Least-squares regression line: y = f} + ft\x. 

7. Con de nee interval for /? : 

(a) Determine the critical value t a /2 such that F (ta/2) = 1 — Oijl, where 
F (■) is the cumulative distribution function for the i-distribution with 
to — 2 degrees of freedom. 

(b) Compute the point estimate /3 . 



(c) Compute k = t a / 2 s e 



\ 



+ 



E ( Xi ~ x ) 2 

i=l 
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(d) The 100(1 — a) percent con den ce interval for /? is given by 
[3b -kj +*]. 



8. Con de nee interval for /3i : 

(a) Determine the critical value t a / 2 such that F {t a / 2 ) = 1 — a/2, where 
F (•) is the cumulative distribution function for the i-distribution with 
to — 2 degrees of freedom. 

(b) Compute the point estimate fi\ . 

(c) Compute k = t a / 2 - 



\ 



^2 ( x i - x ? 

i=l 



(d) The 100(1 — a) percent con den ce interval for Pi is given by 



9. Con de nee interval for a 2 : 

(a) Determine the critical values X 2 a / 2 an ^ x\- a / 2 sucn mat F (xa/2) = 

1 — a/2 and F (xl-a/^j = a/2, where F (•) is the cumulative distribu- 
tion function for the chi-square distribution function with to — 2 degrees 
of freedom. 

(b) Compute the point estimate a 2 . 

, , „ , (n - 2)^2 ( n - 2)^ 

(c) Compute k\ = ^ and k 2 = — ^ . 

X-a/2 X-l-a/2 

(d) The 100(1 — a) percent con den ce interval for a 2 is given by [k\ , k 2 ]. 

10. Con de nee interval (predictive interval) for y, given xq- 

(a) Determine the critical value t a / 2 such that F {t a / 2 ) = 1 — a/2, where 
F (■) is the cumulative distribution function for the i-distribution with 
to — 2 degrees of freedom. 

(b) Compute the point estimates /3q, Pi, and s e . 



(c) Compute k = t a / 2 s e 



\ 



1 (xo — x) ^ <j 

— h — and y = po + pixo- 

TO 



( X i ~ X f 

i=l 

(d) The 100(1 — a) percent con den ce interval for Pi is given by 
[y-k,y + k]. 



11. Test of the hypothesis Pi = against the alternative Pi ^ 0: 

(a) Determine the critical value i a / 2 sucn that F (i a /2) = 1 - a/2, where 
F (•) is the cumulative distribution function for the i-distribution with 
to — 2 degrees of freedom. 
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(b) Compute the point estimates fi\ and s e . 

Pi ™ 2 

(c) Compute the test statistic t = — > (xj — x) . 

(d) If \t\ > t a /2, then reject the hypothesis. If \t\ < t a /2, then do not reject 
the hypothesis. 



7.12.2 GENERAL MODEL y = o + /5 lXl +0 2 x 2 + ---+ n x n + e 
1. The m equations (i = 1,2, ... ,m) 

Hi = Po + PlXn + @2Xi2 H 1" PnXin + <U (7.12.1) 

can be written in matrix notation as y = X{3 + e where 



(7.12.2) 





~yi~ 








ei 






P = 


Pi 




£2 


y = 




A. 


, e = 





and 



X 



1 x n X12 

1 X21 X22 



Xln 
X2n 



(7.12.3) 



_1 X m i X m 2 ' ' ' X m 

2. Throughout the remainder of the section, we assume X has full column rank. 

3. The least-squares estimate P satis es the normal equations X T XP = X T y. 
That is, P = (X T X) _1 X T y. 

4. Point estimate of a 2 : 



m — n 



5. The standard error of the estimate is de ned as s e = V a' 2 . 

6. Least-squares regression line: y = x T p. 

7. In the following, let c,j denote the (i, j) th entry in the matrix (X T X) 1 . 

8. Con de nee interval for 

(a) Determine the critical value t a / 2 such that F (t a /2) = 1 - a/2, where 
F (•) is the cumulative distribution function for the i-distribution with 
m — n — 1 degrees of freedom. 
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(b) Compute the point estimate by solving the normal equations, and 
compute s e . 

(c) Compute^ = t a / 2 s ey /c^. 

(d) The 100(1 — a) percent con den ce interval for is given by 

^Pi ~ k>i, Pi + kf 



2. 



9. Con de nee interval for a 

(a) Determine the critical values X„/2 Xi-a/2 sucn mat ^ (xa/2) = 

1 — a/2 and F = wnere F (') i s me cumulative distri- 

bution function for the chi-square distribution function with to — n — 1 
degrees of freedom. 

(b) Compute the point estimate a 2 . 

, (m — n — 1)<7 2 , , (m — n — 1)<7 2 

(c) Compute k\ = ^ and k 2 = 2 • 

(d) The 100(1 — a) percent con den ce interval for a 2 is given by [k\ , k 2 ]. 

10. Con de nee interval (predictive interval) for y, given x : 

(a) Determine the critical value t a / 2 such that F (ta/2) = 1 — a/2, where 
F (•) is the cumulative distribution function for the i-distribution with 
n — m — 1 degrees of freedom. 

(b) Compute the point estimate by solving the normal equations, and 
compute s e . 

(c) Compute k = t a / 2 s e \jl + xj (X T X) 1 x and y = 

(d) The 100(1— a) percent con dence interval for Pi is given by [y — k, y + k]. 



11. Test of the hypothesis Pi =0 against the alternative /?, ^ 0: 

(a) Determine the critical value i a / 2 suc h that F (t a /2) = 1 — a/2, where 
F (•) is the cumulative distribution function for the i-distribution with 
to — n — 1 degrees of freedom. 

(b) Compute the point estimates /3, and s e by solving the normal equations. 



(c) Compute the test statistic t = 




(d) If \t\ > t a / 2 , then reject the hypothesis. If \t\ < t a / 2 , then do not reject 
the hypothesis. 



7.1 3 ANALYSIS OF VARIANCE (ANOVA) 

Analysis of variance (ANOVA) is a statistical methodology for determining informa- 
tion about means. The analysis uses variances both between and within samples. 
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7.13.1 ONE-FACTOR ANOVA 

1 . Suppose we have k samples from k populations, with the j th population con- 
sisting of rij observations, 

2/11,2/21, ...,2/nil 
2/12,2/22, ...,2/n 2 2 



V\k,Vlk, ■■■,Vn h k- 

2. One-factor model: 

(a) The one-factor ANOVA assumes that the i th observation from the j th 
sample is of the form = [i + Tj + eij . 

(b) For j = 1, 2, . . . , k, the parameter [ij = [i + tj is the unknown mean of 
the j th population, and 2~2j=i Tj = 0. 

(c) For i = 1, 2, . . . , k and j = 1,2, ... ,rij, the random variables e,j are 
independent and normally distributed with mean zero and variance a 2 . 

(d) The total number of observations is n = n i + n-2 + ■ ■ ■ + n& . 

3. Point estimates of means: 

^ k rij 

(a) Total sample mean y = — ^ ^ y^. 

n j=i i=i 

^ «j 

(b) Sample mean of j lh sample yj = — ^ yij. 

4. Sums of squares: 

k 

(a) Sum of squares between samples SSb = ^ rij (yj — yf ■ 

j'=i 

ft n,- 

(b) Sum of squares within samples SS W = ^ ^ (y^ — yj) 2 . 

k rtj 

(c) Total sum of squares Total SS = ^ ^ (y^ — yf . 

(d) Partition of total sum of squares Total SS = SSb + SS W . 

5. Degrees of freedom: 

(a) Between samples, k — 1. 

(b) Within samples, n — k. 

(c) Total, n — 1. 



© 2003 by CRC Press LLC 



6. Mean squares: 



(a) Obtained by dividing sums of squares by their respective degrees of 
freedom. 

SS b 

(b) Between samples, MSb 



k - 1 

(c) Within samples (also called the residual mean square), MS V 



SS V 



k 



7. Test of the hypothesis \i\ = fi 2 = • • • = against the alternative /x, ^ fij for 
some i and j; equivalently, test the null hypothesis n = t 2 = • • • = tu = 
against the hypothesis tj ^ for some j: 

(a) Determine the critical value F a such that F (F a ) = 1 — a, where F (•) 
is the cumulative distribution function for the F-distribution with k — 1 
and n — k degrees of freedom. 

(b) Compute the point estimates y and yj for j = 1,2, ... ,k. 

(c) Compute the sums of squares SSb and SS W . 

(d) Compute the mean squares MSb and MS W . 

, . „ , • • -rn M Sb 

(e) Compute the test statistic F = . 

H MS W 

(f) If F > F a , then reject the hypothesis. If F < F a , then do not reject the 

hypothesis. 

(g) The above computations are often organized into an ANOVA table: 



Source 


SS D.O.F. MS 


F Ratio 


Between samples 
Within samples 


SS b k-1 MS b 

SS W n — k MS W 


rp — MS b 
r ~ MS W 


Total 


Total SS n-1 





8. Con de nee interval for /x, — fij, for i ^ j: 

(a) Determine the critical value t a / 2 such that F (t a / 2 ) = 1 - a/2, where 
F (•) is the cumulative distribution function for the i-distribution with 
n — k degrees of freedom. 

(b) Compute the point estimates and yj. 

(c) Compute the residual mean square MS W . 



(d) Compute k = t a / 2 




(e) The 100(1 — a) percent con de nee interval for fi t 

Vj) -k,(yi - yj) +k]. 



is given by 



9. Con 



>n de nee interval for contrast in the means, de ned by C = ci/ii + c 2 [i 2 + 
• + cuHk, where c\ + c 2 + ■ ■ ■ + cu = 0: 

(a) Determine the critical value F a such that F (F a ) = 1 - a, where F (•) 
is the cumulative distribution function for the F-distribution with k — 1 
and n — k degrees of freedom. 
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(b) Compute the point estimates yj for j = 1,2, ... ,k. 

(c) Compute the residual mean square MS W . 



(d) Compute k 



\ 



n A — ' J 

3=1 



(e) The 100(1 — a) percent con den ce interval for the contrast C is given 

k k 



by 



3 = 1 3=1 



7.13.2 UNREPLICATED TWO-FACTOR ANOVA 

1. Suppose we have a sample of observations indexed by two factors i = 
1,2, ... , m and j = 1,2, ... ,n. 

2. Unreplicated two-factor model: 

(a) The unreplicated two-factor ANOVA assumes that the i j th observation is 
of the form y i3 - = [i + fa + Tj + eij . 

(b) [i is the overall mean, /3, is the i th differential effect of factor one, tj is 
the j differential effect of factor two, and 

m n 

$> = $> i = o. 

i=l j=l 

(c) For i = 1,2, ... , to and j = 1, 2, . . . , n, the random variables e,j are 
independent and normally distributed with mean zero and variance a 2 . 

(d) Total number of observations is ran. 



3. Point estimates of means: 

m n 

(a) Total sample mean y = > > . 

ran 

1=1 j = l 

1 " 

(b) i th factor-one sample mean y t . = — ^ y^. 

71 3=1 
^ m 

(c) j th factor-two sample mean y.j = — ^ y^. 



m . 
%=i 



4. Sums of squares: 

m 

(a) Factor-one sum of squares SSi = n ^ (y,. — yf . 



i=l 



(b) Factor-two sum of squares SS2 = to ^ (y.j — yf 

3=1 
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(c) Residual sum of squares SS r = ^ ^ (yij — y,. — y.j + y) 2 . 

n m 

(d) Total sum of squares Total SS = ^ ^ (j/y —yf. 

(e) Partition of total sum of squares Total SS = SSi + SS 2 + SS r . 



5. Degrees of freedom: 

(a) Factor one, m — 1. 

(b) Factor two, n — 1. 

(c) Residual, (m - l)(n - 1). 

(d) Total, mn — 1. 

6. Mean squares: 

(a) Obtained by dividing sums of squares by their respective degrees of 
freedom. 

SS 

(b) Factor-one mean square MS i = -. 

to — 1 
SS 2 

(c) Factor-two mean square MS 2 = . 

n — 1 

(d) Residual mean square MS r 



(to - l)(n - 1)' 

7. Test of the null hypothesis fi\ = fa = ■ ■ ■ = (3 m = (no factor-one effects) 
against the alternative hypothesis ^ for some i: 

(a) Determine the critical value F a such that F (F a ) = 1 - a, where F (•) 
is the cumulative distribution function for the i^-distribution with to — 1 
and (m — l)(n — 1) degrees of freedom. 

(b) Compute the point estimates y and y t . fori = 1,2, ... ,m. 

(c) Compute the sums of squares SSi and SS r . 

(d) Compute the mean squares MS i andMS r . 

(e) Compute the test statistic F = -. 

H MS r 

(f) If F > F a , then reject the hypothesis. If F < F a , then do not reject the 

hypothesis. 

8. Test of the null hypothesis n = Ti = ■ ■ ■ = t„ = (no factor-two effects) 
against the alternative hypothesis tj ^ for some j: 

(a) Determine the critical value F a such that F (F a ) = 1 — a, where F (•) 
is the cumulative distribution function for the F-distribution with n — 1 
and (to — l)(n — 1) degrees of freedom. 

(b) Compute the point estimates y and y.j for j = 1,2,. . . ,n. 

(c) Compute the sums of squares SS2 and SS r . 
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(d) Compute the mean squares MS 2 and MS r . 

(e) Compute the test statistic F = . 

(f) If F > F a , then reject the hypothesis. If F < F a , then do not reject the 
hypothesis. 

(g) The above computations are often organized into an ANOVA table: 



Source 


SS 


D.O.F. 


MS 


F Ratio 


Factor one 
Factor two 
Residual 


SSi 
SS 2 
SS r 


TO — 1 

n — 1 
(to - l)(n - 1) 


MSi 
MS 2 
MS r 


P _ MSi 
r ~ MS, 
p _ MS 2 
MS, 


Total 


Total SS 


ran — 1 







9. Con de nee interval for contrast in the factor-one means, de ned by C = 
c\P\ + C2P2 H h c m p m , where ci + c 2 H h c m = 0: 

(a) Determine the critical value F a such that F (F a ) = 1 — a, where F (•) 
is the cumulative distribution function for the i^-distribution with to — 1 
and (to — l)(n — 1) degrees of freedom. 

(b) Compute the point estimates y t . fori = 1,2, ... ,m. 

(c) Compute the residual mean square MS r . 



(d) Compute k 



\ 



F a MS r 




(e) The 100(1 — a) percent con den ce interval for the contrast C is given 
by 



i=l 



10. Con de nee interval for contrast in the factor-two means, de ned by C = 
c\T\ + C2T2 + ■ ■ ■ + c n T n , where c\ + c 2 + • • • + c„ = 0: 

(a) Determine the critical value F a such that F (F a ) = 1 — a, where F (•) 
is the cumulative distribution function for the F-distribution with n — 1 
and (to — l)(n — 1) degrees of freedom. 

(b) Compute the point estimates y.j for j = 1, 2, . . . , n. 

(c) Compute the residual mean square MS r . 



(d) Compute k 



\ 



(e) The 100(1 - a 
by 



F a MS r 



2 | 

TO ^ J j ' 

i=l / 



percent con den ce interval for the contrast C is given 



3=1 3=1 
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7.13.3 REPLICATED TWO-FACTOR ANOVA 



1. Suppose we have a sample of observations indexed by two factors i = 
1,2, ... , m and j = 1,2, ... ,n. Moreover, there are p observations per factor 
pair indexed by k = 1,2, . . . ,p. 

2. Replicated two-factor model: 

(a) The replicated two-factor ANOVA assumes that the ijk th observation is 
of the form y ijk = fi + ft + tj + jij + e ijk . 

(b) /i is the overall mean, ft is the i th differential effect of factor one, tj is 
the j differential effect of factor two, and 



(c) For i = 1,2, ... , to and j = 1,2, ... ,n, jij is the if" interaction effect 
of factors one and two. 

(d) For i = 1,2,..., to, j = 1,2, ... ,n, and k = 1, 2, . . . ,p, the random 
variables are independent and normally distributed with mean zero 
and variance a' 2 . 

(e) Total number of observations is mnp. 

3. Point estimates of means: 



m 



n 




8 = 1 



J' = l 



1 



mnp 



(a) Total sample mean y 



mnp 





i-l j-l k=l 

1 n P 



(b) i factor-one sample mean y,.. 




m p 



(C) j 



factor-two sample mean y.j. 



(d) if h interaction mean y^. = -^yijk- 

P k=l 



4. Sums of squares: 



m 



(a) Factor-one sum of squares SSi = npV — y) . 





n 



(b) Factor-two sum of squares SS2 = mp^2 (V-j- ~ vf ■ 



m n 



(c) Interaction sum of squares SS 12 = p ^ ^ (yij- —y) 2 - 

i=i j=i 
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m n V 

(d) Residual sum of squares SS r = ^ ^ ^ (j/yj, — y,.. — y.j. + y) . 

i-l j-l k=l 
m n p 

(e) Total sum of squares Total SS = ^ ^ ^ (y^ — yf . 

i-l j-l k=l 

(f) Partition of total sum of squares Total SS = SSi + SS 2 + SS12 + SS r . 

5. Degrees of freedom: 

(a) Factor one, m — 1. 

(b) Factor two, n — 1. 

(c) Interaction, (to — l)(n — 1). 

(d) Residual, mn(p — 1). 

(e) Total, mnp — 1 . 

6. Mean squares: 

(a) Obtained by dividing sums of squares by their respective degrees of 
freedom. 

SSi 

(b) Factor-one mean square MS 1 = . 

to — 1 
SS 2 

(c) Factor-two mean square MS 2 = -■ 

n — 1 

SS12 

(d) Interaction mean square MS 12 



(to - l)(n - 1)' 
SS 

(e) Residual mean square MS r = — . 

mn(p — 1) 

7. Test of the null hypothesis fi\ = fa = ■ ■ ■ = (3 m = (no factor-one effects) 
against the alternative hypothesis ^ for some i: 

(a) Determine the critical value F a such that F (F a ) = 1 — a, where F (•) 
is the cumulative distribution function for the F-distribution with to — 1 
and mn(p — 1) degrees of freedom. 

(b) Compute the point estimates y and for i = 1, 2, . . . , m. 

(c) Compute the sums of squares SSi and SS r . 

(d) Compute the mean squares MS 1 andMS r . 

, s „ , • • rn MSi 

(e) Compute the test statistic F = . 

(f) If F > F a , then reject the hypothesis. If F < F a , then do not reject the 
hypothesis. 

8. Test of the null hypothesis n = T2 = • • • = t„ = (no factor-two effects) 
against the alternative hypothesis tj ^ for some j: 

(a) Determine the critical value F a such that F (F a ) = 1 - a, where F (•) 
is the cumulative distribution function for the F-distribution with n — 1 
and mn(p — 1) degrees of freedom. 
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(b) Compute the point estimates y and y.j. for j = 1, 2, . . . , n. 

(c) Compute the sums of squares SS2 and SS r . 

(d) Compute the mean squares MS 2 and MS r . 

(e) Compute the test statistic F = . 

(f) If F > F a , then reject the hypothesis. If F < F a , then do not reject the 
hypothesis. 



9. Test of the null hypothesis 7^ = for i = 1, 2, . . . , m and j = 1, 2, . . . , n (no 
factor-one effects) against the alternative hypothesis 7,j ^ for some i and j: 

(a) Determine the critical value F a such that F (F a ) = 1 - a, where F (•) 
is the cumulative distribution function for the F-distribution with (to — 
l)(n — 1) and mn(p — 1) degrees of freedom. 

(b) Compute the point estimates y, y,.., y.j., and y t j. for i = 1, 2, . . . , to and 
j = 1,2,..., n. 

(c) Compute the sums of squares SS12 and SS r . 

(d) Compute the mean squares MS 12 and MS r . 

(e) Compute the test statistic F = — . 

MS r 

(f) If F > F a , then reject the hypothesis. If F < F a , then do not reject the 
hypothesis. 

(g) The above computations are often organized into an ANOVA table: 



Source 


SS 


D.O.F. 


MS 


F Ratio 


Factor one 


SSi 


TO — 1 


MSj 


F = MSi/MS r 


Factor two 


ss 2 


n — 1 


MS 2 


F = MS 2 /MS r 


Interaction 


SS12 


(to — l)(n — 1) 


MS12 


F = MSi 2 /MS r 


Residual 


ss r 


mn(p — 1) 


MS r 




Total 


Total SS 


mnp — 1 







10. Con de nee interval for contrast in the factor-one means, de ned by C = 
c\P\ + C2P2 H h c m p m , where c x + c 2 H h c m = 0: 

(a) Determine the critical value F a such that F (F a ) = 1 - a, where F (•) 
is the cumulative distribution function for the ^-distribution with to — 1 
and mn(p — 1) degrees of freedom. 

(b) Compute the point estimates y,.. for i = 1,2, ... ,m. 

(c) Compute the residual mean square MS r . 



(d) Compute k 



F a MS r 



TO 



np 



1 m 



i=l 



(e) The 100(1 — a) percent con den ce interval for the contrast C is given 
by 



.«=i 
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1 1 . Con de nee interval for contrast in the factor-two means, de ned by C = 
c\T\ + c 2 t 2 + ■ ■ ■ + c n T n , where c\ + c 2 + • • • + c„ = 0: 

(a) Determine the critical value F a such that F (F a ) = 1 — a, where F (•) 
is the cumulative distribution function for the F-distribution with n — 1 
and mn(p — 1) degrees of freedom. 

(b) Compute the point estimates y.j. for j = 1,2, ... ,n. 

(c) Compute the residual mean square MS r . 



(d) Compute k 



\ 



F a MS r 



mp J I 



(e) The 100(1 - a) percent con den ce interval for the contrast C is given 
by 



3=1 3=1 



FIGURE 7.5 

The shaded region is de ned by X > Za and has area a (here X is N(0, 1) ). 




7.14 PROBABILITY TABLES 



7.14.1 CRITICAL VALUES 

1. The critical value z a satis es $(z a ) = 1 — a (where, as usual, §(z) is the 
distribution function for the standard normal). See Figure 7.5. 

2. The critical value t a satis es F(t a ) = 1 — a where F(-) is the distribution 
function for the f-distribution (for a speci ed number of degrees of freedom). 
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FIGURE 7.6 

Illustration of a and 2a regions of a normal distribution. 




3. The critical value x\ sat i s es F(Xa) = 1 ~ a where F(-) is the distribution 
function for the \ 2 -distribution (for a speci ed number of degrees of freedom). 

4. The critical value F a satis es F(F a ) = 1 — a where F(-) is the distribution 
function for the F-distribution (for a speci ed number of degrees of freedom). 



7.14.2 TABLE OF THE NORMAL DISTRIBUTION 

For a standard normal random variable (see Figure 7.6): 



Limits 


Proportion of 
the total area 


Remaining 
area 


fi — Xa 


fi + Xa 


(%) 


(%) 


[i — a 


/i + a 


68.27 


31.73 


ji — 1.65cr 


ji + 1.65(7 


90 


10 


li - 1.96cr 


li+ 1.96(7 


95 


5 


H — 2(7 


11 + 2(7 


95.45 


4.55 


li - 2.58cr 


li + 2.58(7 


99.0 


0.99 


jl — 3(7 


jl + 3(7 


99.73 


0.27 


li - 3.09(7 


li + 3.09(7 


99.8 


0.2 


fi - 3.29cr 


(i + 3.29cr 


99.9 


0.1 



X 


1.282 1.645 1.960 2.326 2.576 3.090 


${x) 
2[1 - 9(x)] 


0.90 0.95 0.975 0.99 0.995 0.999 
0.20 0.10 0.05 0.02 0.01 0.002 



X 


3.09 3.72 4.26 4.75 5.20 5.61 6.00 6.36 


1 - $(x) 


10" 3 10" 4 10" 5 10" 6 10" 7 10" 8 10" 9 10" 10 



For large values of x: 
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V2lr \x x 3 J 



X 


Fix) 


1 - F{x) 


fix) 


X 


Fix) 


1 - Fix) 


fix) 


0.01 


0.50399 


0.49601 


0.39892 


0.02 


0.50798 


0.49202 


0.39886 


0.03 


0.51197 


48803 


39876 

yy • **/ .y w / w 


0.04 


51595 


48405 

w ■ r w rw*/ 


39862 

W * ^ ' y W V ^— 


0.05 


0.51994 


48006 


0.39844 


0.06 


0.52392 


47608 

w- r / www 


39822 


0.07 


0.52790 


0.47210 


0.39797 


0.08 


53188 

\J • */ *y 1 WW 


0.46812 


0.39767 


0.09 


53586 

w • */ */ */ w w 


0.46414 


39733 

yy ■ * ' y i */ */ 


0.10 


53983 

V / . - ' y W */ 


0.46017 


39695 

w ■ ' y v_/ .y 


0.11 


0.54380 


0.45621 


0.39654 


0.12 


0.54776 


0.45224 


0.39608 


0.13 


0.55172 


0.44828 


0.39559 


0.14 


0.55567 


0.44433 


0.39505 


0.15 


0.55962 


0.44038 


0.39448 


0.16 


0.56356 


0.43644 


0.39387 


0.17 


0.56749 


0.43250 


0.39322 


0.18 


0.57142 


0.42858 


0.39253 


0.19 


0.57534 


0.42466 


0.39181 


0.20 


0.57926 


0.42074 


0.39104 


0.21 


58317 

W • */ W»/ A. 1 


41683 

v / ■ r i v./ w ^ ' 


0.39024 


0.22 


58706 


0.41294 


38940 

w • */ w y ■ \y 


0.23 


59095 

W • */ y W y ^' 


40905 

v./ ■ r \y y w*/ 


38853 

W ■ */ WW */ */ 


0.24 


0.59484 


40516 

w ■ ruj -i- w 


38762 

W«*/W / V ^— 


0.25 


0.59871 


0.40129 


38667 

W-*/WWW / 


0.26 


60257 

w>ww^-*/ / 


0.39743 


38568 

w • */ w */ w w 


0.27 


60642 

w . w v./ v./ r — 


39358 


38466 

W ■ */ w rw w 


0.28 


61026 

W % W -1- W^rf w 


0.38974 


38361 

W • */ W */ W J- 


0.29 


0.61409 


0.38591 


0.38251 


0.30 


0.61791 


0.38209 


0.38139 


0.31 


0.62172 


0.37828 


0.38023 


0.32 


0.62552 


0.37448 


0.37903 


0.33 


0.62930 


0.37070 


0.37780 


0.34 


0.63307 


0.36693 


0.37654 


0.35 


0.63683 


0.36317 


0.37524 


0.36 


0.64058 


0.35942 


0.37391 


0.37 


0.64431 


0.35569 


0.37255 


0.38 


0.64803 


0.35197 


0.37115 


0.39 


0.65173 


0.34827 


0.36973 


0.40 


0.65542 


0.34458 


0.36827 


0.41 


65910 

v./ . \y ^ > y i v./ 


34090 


36678 

W-*/WW ' w 


0.42 


66276 

v / . v' v/— / w 


0.33724 


36526 

w - */ w*/ ^ w 


0.43 


66640 

W . V/ V/ V./ rW 


33360 

W > */ *J */ WW 


36371 

W ■ */ W*/ I J. 


0.44 


67003 

W>W ' WW*./ 


0.32997 


36213 

W - */ W^rf J- */ 


0.45 


0.67365 


0.32636 


0.36053 


0.46 


0.67724 


0.32276 


0.35889 


0.47 


0.68082 


0.31918 


0.35723 


0.48 


0.68439 


0.31561 


0.35553 


0.49 


0.68793 


0.31207 


35381 

W ■ */ */ *y W I 


0.50 


0.69146 


30854 

w ■ */ ww*/ r 


0.35207 


0.51 


0.69497 


0.30503 


0.35029 


0.52 


0.69847 


0.30153 


0.34849 


0.53 


0.70194 


0.29806 


0.34667 


0.54 


0.70540 


0.29460 


0.34482 


0.55 


0.70884 


0.29116 


0.34294 


0.56 


0.71226 


0.28774 


0.34105 


0.57 


0.71566 


0.28434 


0.33912 


0.58 


0.71904 


0.28096 


0.33718 


0.59 


0.72240 


0.27759 


0.33521 


0.60 


0.72575 


0.27425 


0.33322 


0.61 


0.72907 


0.27093 


0.33121 


0.62 


0.73237 


0.26763 


0.32918 


0.63 


0.73565 


0.26435 


0.32713 


0.64 


0.73891 


0.26109 


0.32506 


0.65 


0.74215 


25785 

V / . ^— I W*/ 


0.32297 


0.66 


0.74537 


25463 

w • — r w ' 


32086 

W - ' — V/ w w 


0.67 


0.74857 


0.25143 


0.31874 


0.68 


0.75175 


0.24825 


31659 

W ■ ' I W*/ y 


0.69 


0.75490 


0.24510 


0.31443 


0.70 


75804 

w % i ^/ww r 


0.24196 


0.31225 


0.71 


0.76115 


0.23885 


0.31006 


0.72 


0.76424 


0.23576 


0.30785 


0.73 


0.76731 


0.23270 


0.30563 


0.74 


0.77035 


0.22965 


0.30339 


0.75 


0.77337 


0.22663 


0.30114 


0.76 


0.77637 


0.22363 


0.29887 


0.77 


0.77935 


0.22065 


0.29659 


0.78 


0.78231 


0.21769 


0.29430 


0.79 


0.78524 


0.21476 


0.29200 


0.80 


0.78814 


0.21185 


0.28969 
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X 


Fix) 


1 - F(x) 


fix) 


X 


Fix) 


1 - F{x) 


fix) 


0.81 


0.79103 


0.20897 


0.28737 


0.82 


0.79389 


0.20611 


0.28504 


0.83 


0.79673 


20327 


28269 


0.84 


0.79955 


20045 


28034 


0.85 


80234 


0.19766 


0.27798 


0.86 


80510 

\y m\j \j^y J. v / 


0.19490 


0.27562 


0.87 


80785 


0.19215 


0.27324 


0.88 


81057 

\y m\j A. yy *y 1 


0.18943 


27086 


0.89 


0.81327 


18673 


26848 


0.90 


0.81594 


18406 


26609 

v./ . — v./ v./ y 


0.91 


0.81859 


0.18141 


0.26369 


0.92 


0.82121 


0.17879 


0.26129 


0.93 


0.82381 


0.17619 


0.25888 


0.94 


0.82639 


0.17361 


0.25647 


0.95 


0.82894 


0.17106 


0.25406 


0.96 


0.83147 


0.16853 


0.25164 


0.97 


0.83398 


0.16602 


0.24923 


0.98 


0.83646 


0.16354 


0.24681 


0.99 


0.83891 


0.16109 


0.24439 


1.00 


0.84135 


0.15865 


0.24197 


1.01 


84375 


15625 


23955 

v / ■ — ^'y +j +j 


1.02 


0.84614 


15386 

v / - j_ ^y .y \y V/ 


0.23713 


1.03 


0.84849 


0.15151 


0.23471 


1.04 


85083 

\j * \j *y \j kj -y 


0.14917 


0.23230 


1.05 


85314 


14686 


22988 


1.06 


85543 

\j * yy *y *y ■ ^ / 


0.14457 


0.22747 


1.07 


85769 


0.14231 


22506 


1.08 


85993 


0.14007 


0.22265 


1.09 


0.86214 


0.13786 


0.22025 


1.10 


0.86433 


0.13567 


0.21785 


1.11 


0.86650 


0.13350 


0.21546 


1.12 


0.86864 


0.13136 


0.21307 


1.13 


0.87076 


0.12924 


0.21069 


1.14 


0.87286 


0.12714 


0.20831 


1.15 


0.87493 


0.12507 


0.20594 


1.16 


0.87698 


0.12302 


0.20357 


1.17 


0.87900 


0.12100 


0.20121 


1.18 


0.88100 


0.11900 


0.19886 


1.19 


0.88298 


0.11702 


0.19652 


1.20 


0.88493 


0.11507 


0.19419 


1.21 


88686 


0.11314 


0.19186 


1.22 


88877 

\y m\y\\j\j / i 


0.11123 


0.18954 


1.23 


89065 


10935 


0.18724 


1.24 


0.89251 


0.10749 


0.18494 


1.25 


0.89435 


0.10565 


0.18265 


1.26 


0.89616 


0.10383 


0.18037 


1.27 


0.89796 


0.10204 


0.17810 


1.28 


0.89973 


0.10027 


0.17585 


1.29 


0.90148 


09853 

\J % \J y yJ -y -y 


17360 


1.30 


90320 

v./ ■ y ' yj 


09680 

v./ ■ v./ y uuv 


0.17137 


1.31 


0.90490 


0.09510 


0.16915 


1.32 


0.90658 


0.09342 


0.16694 


1.33 


0.90824 


0.09176 


0.16474 


1.34 


0.90988 


0.09012 


0.16256 


1.35 


0.91149 


0.08851 


0.16038 


1.36 


0.91309 


0.08692 


0.15823 


1.37 


0.91466 


0.08534 


0.15608 


1.38 


0.91621 


0.08379 


0.15395 


1.39 


0.91774 


0.08226 


0.15183 


1.40 


0.91924 


0.08076 


0.14973 


1.41 


0.92073 


0.07927 


0.14764 


1.42 


0.92220 


0.07780 


14556 

v./ . i r / / yj 


1.43 


0.92364 


0.07636 


0.14350 


1.44 


0.92507 


0.07493 


0.14146 


1.45 


0.92647 


07353 


0.13943 


1.46 


0.92785 


0.07215 


0.13742 


1.47 


0.92922 


07078 


0.13542 


1.48 


93056 


0.06944 


13343 


1.49 


0.93189 


06811 

v_7 . v_7 \y yy A a. 


0.13147 


1.50 


0.93319 


0668 1 


0.12952 


1.51 


0.93448 


0.06552 


0.12758 


1.52 


0.93575 


0.06426 


0.12566 


1.53 


0.93699 


0.06301 


0.12376 


1.54 


0.93822 


0.06178 


0.12188 


1.55 


0.93943 


0.06057 


0.12001 


1.56 


0.94062 


0.05938 


0.11816 


1.57 


0.94179 


0.05821 


0.11632 


1.58 


0.94295 


0.05705 


0.11450 


1.59 


0.94408 


0.05592 


0.11270 


1.60 


0.94520 


0.05480 


0.11092 
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X 


Fix) 


1 - F{x) 


fix) 


X 


Fix) 


1 - Fix) 


fix) 


1.61 


0.94630 


0.05370 


0.10916 


1.62 


0.94738 


0.05262 


0.10741 


1.63 


0.94845 


05155 

V7 . V7 1 -7 


10568 

v / - 1 v /.. / \y y.f 


1.64 


0.94950 


05050 

v 7 ■ V7 - ' \J^J \y 


10396 

\J • A. v/*7 .y \J 


1.65 


95053 


0.04947 


0.10226 


1.66 


0.95154 


04846 

v7 - V7 T X.J V \J 


10059 

v7 « i \y y.f ' .y 


1.67 


0.95254 


0.04746 


09892 


1.68 


95352 


04648 

v / ■ V7 r v./ r \j 


09728 


1.69 


0.95449 


04551 


09566 


1.70 


0.95544 


0.04457 


09405 

\j ■ \j y r \7 ^ 7 


1.71 


0.95637 


0.04363 


0.09246 


1.72 


0.95728 


0.04272 


0.09089 


1.73 


0.95818 


0.04181 


0.08933 


1.74 


0.95907 


0.04093 


0.08780 


1.75 


0.95994 


0.04006 


0.08628 


1.76 


0.96080 


0.03920 


0.08478 


1.77 


0.96164 


0.03836 


0.08329 


1.78 


0.96246 


0.03754 


0.08183 


1.79 


0.96327 


0.03673 


0.08038 


1.80 


0.96407 


0.03593 


0.07895 


1.81 


96485 


03515 


0.07754 


1.82 


96562 

v./ ■ .y \y ' 


03438 

v7 m \y * ' r^j yy 


0.07614 


1.83 


96637 


03363 


0.07477 


1.84 


0.96712 


03288 

v7 m \y ' ^— y.f \J 


0.07341 


1.85 


0.96784 


03216 

V7 ■ \J *J £j A. V 


07207 


1.86 


96856 

V./ ■ y \y \y V 


0.03144 


0.07074 


1.87 


96926 

\j • y \y .y x— \j 


03074 

v./ ■ v./ .. ' v./ / r 


06943 


1.88 


0.96995 


03005 

v7 m \y ' UV/J 


06814 


1.89 


0.97062 


0.02938 


0.06687 


1.90 


0.97128 


0.02872 


0.06562 


1.91 


0.97193 


0.02807 


0.06438 


1.92 


0.97257 


0.02743 


0.06316 


1.93 


0.97320 


0.02680 


0.06195 


1.94 


0.97381 


0.02619 


0.06076 


1.95 


0.97441 


0.02559 


0.05960 


1.96 


0.97500 


0.02500 


0.05844 


1.97 


0.97558 


0.02442 


0.05730 


1.98 


0.97615 


0.02385 


0.05618 


1.99 


0.97671 


0.02329 


0.05508 


2.00 


0.97725 


0.02275 


0.05399 


2.01 


0.97778 


0.02222 


05292 


2.02 


0.97831 


02169 

v7 ■ \j £j i \y y 


05186 

V7 ■ V7 ^ / A. KJ\J 


2.03 


97882 


0.02118 


05082 


2.04 


0.97933 


02067 


04980 

V7 • V7 r .y yy \ / 


2.05 


0.97982 


0.02018 


0.04879 


2.06 


0.98030 


0.01970 


0.04780 


2.07 


0.98077 


0.01923 


0.04682 


2.08 


0.98124 


0.01876 


0.04586 


2.09 


0.98169 


01831 

\J m\J A. \J A. 


0.04491 


2.10 


0.98214 


01786 


04398 

V7 . v/ .y Vy 


2.11 


0.98257 


0.01743 


0.04307 


2.12 


0.98300 


0.01700 


0.04217 


2.13 


0.98341 


0.01659 


0.04128 


2.14 


0.98382 


0.01618 


0.04041 


2.15 


0.98422 


0.01578 


0.03955 


2.16 


0.98461 


0.01539 


0.03871 


2.17 


0.98500 


0.01500 


0.03788 


2.18 


0.98537 


0.01463 


0.03706 


2.19 


0.98574 


0.01426 


0.03626 


2.20 


0.98610 


0.01390 


0.03547 


2.21 


98645 


0.01355 


0.03470 


2.22 


0.98679 


0.01321 


03394 

V7 ■ V7 ^ ' ^ ' v r 


2.23 


0.98713 


0.01287 


0.03319 


2.24 


0.98745 


0.01255 


0.03246 


2.25 


0.98778 


0.01222 


0.03174 


2.26 


98809 

V 7 ■ y \j \.) \7 y 


0.01191 


03103 

V7 « V7 ^ ' 1 \ 7 ^ ' 


2.27 


98840 


0.01160 


03034 

V/ ■ V./ „ / \7 .. f 1 


2.28 


98870 

V7 ■ y \_> \.) t V7 


0.01130 


02966 

V7 ■ V7 .y V7 V.' 


2.29 


0.98899 


0.01101 


02899 


2.30 


98928 

v / ■ y \.y y _ j 


01072 


02833 


2.31 


0.98956 


0.01044 


0.02768 


2.32 


0.98983 


0.01017 


0.02705 


2.33 


0.99010 


0.00990 


0.02643 


2.34 


0.99036 


0.00964 


0.02582 


2.35 


0.99061 


0.00939 


0.02522 


2.36 


0.99086 


0.00914 


0.02463 


2.37 


0.99111 


0.00889 


0.02406 


2.38 


0.99134 


0.00866 


0.02349 


2.39 


0.99158 


0.00842 


0.02294 


2.40 


0.99180 


0.00820 


0.02240 
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X 


Fix) 


1 - F{x) 


fix) 


X 


Fix) 


1 - Fix) 


fix) 


2.41 


0.99202 


0.00798 


0.02186 


2.42 


0.99224 


0.00776 


0.02134 


2.43 


0.99245 


00755 


02083 


2.44 


99266 

v / . y y — v.7 v 


00734 

v / - v./ v./ / » ' r 


02033 


2.45 


99286 


0.00714 


0.01984 


2.46 


0.99305 


0.00695 


01936 


2.47 


0.99324 


00676 


01888 


2.48 


0.99343 


00657 


0.01842 


2.49 


0.99361 


00639 


0.01797 


2.50 


0.99379 


00621 

V / - V./ V / V.' — 1 


01753 


2.51 


0.99396 


0.00604 


0.01709 


2.52 


0.99413 


0.00587 


0.01667 


2.53 


0.99430 


0.00570 


0.01625 


2.54 


0.99446 


0.00554 


0.01585 


2.55 


0.99461 


0.00539 


0.01545 


2.56 


0.99477 


0.00523 


0.01506 


2.57 


0.99491 


0.00509 


0.01468 


2.58 


0.99506 


0.00494 


0.01431 


2.59 


0.99520 


0.00480 


0.01394 


2.60 


0.99534 


0.00466 


0.01358 


2.61 


0.99547 


00453 


01323 


2.62 


99560 

v / * y y ^' v v./ 


00440 

v./ - v./ v./ i rv 


01289 


2.63 


0.99573 


0.00427 


01256 

yj ■ \j j. _ v./ 


2.64 


99586 


0.00415 


0.01223 


2.65 


0.99598 


00402 

v./ ■ v./ v./ r \j x— 


0.01191 


2.66 


0.99609 


00391 


01160 


2.67 


0.99621 


00379 

v./ ■ v./ \j ^> i y 


0.01129 


2.68 


0.99632 


00368 


01100 


2.69 


0.99643 


0.00357 


0.01071 


2.70 


0.99653 


0.00347 


0.01042 


2.71 


0.99664 


0.00336 


0.01014 


2.72 


0.99674 


0.00326 


0.00987 


2.73 


0.99683 


0.00317 


0.00961 


2.74 


0.99693 


0.00307 


0.00935 


2.75 


0.99702 


0.00298 


0.00909 


2.76 


0.99711 


0.00289 


0.00885 


2.77 


0.99720 


0.00280 


0.00860 


2.78 


0.99728 


0.00272 


0.00837 


2.79 


0.99736 


0.00264 


0.00814 


2.80 


0.99745 


0.00255 


0.00792 


2.81 


0.99752 


00248 

v / . v / v./ r yj 


00770 


2.82 


0.99760 


00240 

v / ■ V./ v / z— rv 


00748 

v./ . v./ v./ / r \.> 


2.83 


0.99767 


00233 


0.00727 


2.84 


0.99774 


00226 

v / ■ V./ V / z_» — V./ 


00707 


2.85 


0.99781 


0.00219 


0.00687 


2.86 


0.99788 


0.00212 


0.00668 


2.87 


0.99795 


0.00205 


0.00649 


2.88 


0.99801 


0.00199 


0.00631 


2.89 


0.99807 


00193 

v./ ■ v./ \j i y 


00613 


2.90 


0.99813 


00187 


00595 


2.91 


0.99819 


0.00181 


0.00578 


2.92 


0.99825 


0.00175 


0.00562 


2.93 


0.99830 


0.00169 


0.00545 


2.94 


0.99836 


0.00164 


0.00530 


2.95 


0.99841 


0.00159 


0.00514 


2.96 


0.99846 


0.00154 


0.00499 


2.97 


0.99851 


0.00149 


0.00485 


2.98 


0.99856 


0.00144 


0.00470 


2.99 


0.99860 


0.00139 


0.00457 


3.00 


0.99865 


0.00135 


0.00443 


3.01 


0.99869 


00131 


00430 

v./ ■ v./ v./ r \ j 


3.02 


0.99874 


00126 

v./ - V/ v./ 1 — V/ 


0.00417 


3.03 


0.99878 


0.00122 


0.00405 


3.04 


0.99882 


0.00118 


0.00393 


3.05 


99886 


0.00114 


00381 


3.06 


0.99889 


0.00111 


00369 

\j . v./ v./ ^ ' v_/ y 


3.07 


0.99893 


00107 

\J m \J\y J_ \J 1 


00358 


3.08 


0.99896 


0.00103 


0.00347 


3.09 


0.99900 


00100 


00337 

v / ■ V./ v / ../../ / 


3.10 


0.99903 


00097 

v / ■ V./ \_/ V./ y t 


00327 


3.11 


0.99906 


0.00093 


0.00317 


3.12 


0.99910 


0.00090 


0.00307 


3.13 


0.99913 


0.00087 


0.00298 


3.14 


0.99916 


0.00085 


0.00288 


3.15 


0.99918 


0.00082 


0.00279 


3.16 


0.99921 


0.00079 


0.00271 


3.17 


0.99924 


0.00076 


0.00262 


3.18 


0.99926 


0.00074 


0.00254 


3.19 


0.99929 


0.00071 


0.00246 


3.20 


0.99931 


0.00069 


0.00238 
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X 


Fix) 


1 - F{x) 


fix) 


X 


Fix) 


1 - Fix) 


fix) 


3.21 


0.99934 


0.00066 


0.00231 


3.22 


0.99936 


0.00064 


0.00224 


3.23 


0.99938 


00062 


00216 


3.24 


0.99940 


00060 

yj ■ yjyjyjyjyj 


00210 

yj . v./ v./ i v./ 


3.25 


0.99942 


00058 


00203 

yj ■ v./ z— v./ ^ ' 


3.26 


0.99944 


00056 

yj ■ yjyjyj^j yj 


00196 

yj . v./ v./ i .y yj 


3.27 


0.99946 


00054 


00190 


3.28 


0.99948 


00052 

v / - yjyjyj^j — 


00184 

yj . v./ v./ i \j r 


3.29 


0.99950 


00050 


00178 


3.30 


0.99952 


00048 

v / - yj yj v / r \j 


00172 


3.31 


0.99953 


0.00047 


0.00167 


3.32 


0.99955 


0.00045 


0.00161 


3.33 


0.99957 


0.00043 


0.00156 


3.34 


0.99958 


0.00042 


0.00151 


3.35 


0.99960 


0.00040 


0.00146 


3.36 


0.99961 


0.00039 


0.00141 


3.37 


0.99962 


0.00038 


0.00136 


3.38 


0.99964 


0.00036 


0.00132 


3.39 


0.99965 


0.00035 


0.00128 


3.40 


0.99966 


0.00034 


0.00123 


3.41 


0.99967 


00032 

V./ ■ V./ V./V/ ' Z— 


0.00119 


3.42 


0.99969 


00031 


00115 


3.43 


0.99970 


00030 


0.00111 


3.44 


0.99971 


00029 


00108 

v./ . v./ v./ ± yjyj 


3.45 


0.99972 


00028 


00104 


3.46 


0.99973 


00027 


00100 

v./ . v./ v./ i \j v./ 


3.47 


0.99974 


00026 


00097 

v./ ■ v./ y./ v./ y i 


3.48 


0.99975 


00025 

V./ ■ V./ V./ V 7 — * ' 


00094 

v./ ■ v./ v./ v./ y r 


3.49 


0.99976 


0.00024 


0.00090 


3.50 


O.99977 


0.00023 


0.00087 


3.51 


0.99978 


0.00022 


0.00084 


3.52 


0.99979 


0.00021 


0.00081 


3.53 


0.99979 


0.00021 


0.00078 


3.54 


0.99980 


0.00020 


0.00076 


3.55 


0.99981 


0.00019 


0.00073 


3.56 


0.99982 


0.00018 


0.00071 


3.57 


0.99982 


0.00018 


0.00068 


3.58 


0.99983 


0.00017 


0.00066 


3.59 


0.99984 


0.00016 


0.00063 


3.60 


0.99984 


0.00016 


0.00061 


3.61 


0.99985 


00015 


00059 


3.62 


0.99985 


00015 

v / ■ yjyjyj i -. ' 


00057 

yj - yj yj yj-j i 


3.63 


0.99986 


00014 


00055 


3.64 


0.99986 


00014 


00053 

yj . v./ v./ v./ » / 


3.65 


0.99987 


0.00013 


0.00051 


3.66 


0.99987 


0.00013 


0.00049 


3.67 


0.99988 


0.00012 


0.00047 


3.68 


0.99988 


0.00012 


0.00046 


3.69 


0.99989 


00011 


00044 

yj ■ V/ v./ v./ i r 


3.70 


0.99989 


00011 

yjmyjyjyjA. j_ 


00042 

yj . v./ v./ yj r z— 


3.71 


0.99990 


0.00010 


0.00041 


3.72 


0.99990 


0.00010 


0.00039 


3.73 


0.99990 


0.00010 


0.00038 


3.74 


0.99991 


0.00009 


0.00037 


3.75 


0.99991 


0.00009 


0.00035 


3.76 


0.99991 


0.00009 


0.00034 


3.77 


0.99992 


0.00008 


0.00033 


3.78 


0.99992 


0.00008 


0.00032 


3.79 


0.99992 


0.00007 


0.00030 


3.80 


0.99993 


0.00007 


0.00029 


3.81 


O.99993 


00007 


00028 


3.82 


O.99993 


00007 

V./ - V/ V./ V 7 V./ / 


00027 

V./ . V./ V./ v.^ / 


3.83 


0.99994 


0.00006 


0.00026 


3.84 


0.99994 


0.00006 


0.00025 


3.85 


0.99994 


00006 


00024 


3.86 


0.99994 


00006 

V / - V./ V / V 7 V./ V./ 


00023 

v./ . v/ yj yj 


3.87 


0.99995 


00005 


00022 


3.88 


0.99995 


00005 


00021 

yj . v./ v./ v/ i 


3.89 


0.99995 


00005 


00021 


3.90 


0.99995 


00005 

yj ■ yjyjyjK/^j 


00020 

yj • yj yj yj£j yj 


3.91 


0.99995 


0.00005 


0.00019 


3.92 


0.99996 


0.00004 


0.00018 


3.93 


0.99996 


0.00004 


0.00018 


3.94 


0.99996 


0.00004 


0.00017 


3.95 


0.99996 


0.00004 


0.00016 


3.96 


0.99996 


0.00004 


0.00016 


3.97 


0.99996 


0.00004 


0.00015 


3.98 


0.99997 


0.00003 


0.00015 


3.99 


0.99997 


0.00003 


0.00014 


4.00 


0.99997 


0.00003 


0.00013 
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7.14.3 PERCENTAGE POINTS, STUDENT'S ^-DISTRIBUTION 

For a given value of n and a this table gives the value of t such that 



r((n + l)/2) 

miT(n/2) V n 



-(n+l)/2 



cfe = 1 — a. 



(7.14.3) 



The ^-distribution is symmetrical, so that F(—t) = 1 — F(t). 

EXAMPLE The table gives i Q=0 . 60jn=2 = 0.325. 
Hence, when n = 2, F(0.325) = 0.4. 



n 


F(t) = 


0.6000 


0.7500 


0.9000 


0.9500 


0.9750 


0.9900 


0.9950 


0.9990 


0.9995 


1 


0.325 


1.000 


3.078 


6.314 


12.706 


31.821 


63.657 


318.309 


636.619 


2 


0.289 


0.816 


1.886 


2.920 




6.965 




22.327 


j i .~>yy 


3 


0.277 


0.765 


1.638 


2.353 


3.182 


4.541 


5.841 


10.215 


12.924 


4 


0.271 


0.741 


1.533 


2.132 


2.776 


3.747 


4.604 


7.173 


8.610 


5 


0.267 


0.727 


1.476 


2.015 


2.571 


3.365 


4.032 


5.893 


6.869 


6 


0.265 


0.718 


1.440 


1.943 


2.447 


3.143 


3.707 


5.208 


5.959 


7 


v.Zoj 


U. / 1 1 


1.41 J 


1 QQ'n 
1 .oVj 


L. JO J 


Z.yyo 


^ /1QQ 


4. /OJ 


^ /ins 


s 

o 


0.262 


0.706 


1.397 


1.860 


2.306 


2.896 


3.355 


4.501 


5.041 


9 


0.261 


0.703 


1.383 


1.833 


2.262 


2.821 


3.250 


4.297 


4.781 


10 


0.260 


0.700 


1.372 


1.812 


2.228 


2.764 


3.169 


4.144 


4.587 


11 


0.260 


0.697 


1.363 


1.796 


2.201 


2.718 


3.106 


4.025 


4.437 


12 


0.259 


0.695 


1.356 


1.782 


2.179 


2.681 


3.055 


3.930 


4.318 


13 


0.259 


0.694 


1.350 


1.771 


2.160 


2.650 


3.012 


3.852 


4.221 


14 


0.258 


0.692 


1.345 


1.761 


2.145 


2.624 


2.977 


3.787 


4.140 


15 


0.258 


0.691 


1.341 


1.753 


2.131 


2.602 


2.947 


3.733 


4.073 


16 


0.258 


0.690 


1.337 


1.746 


2.120 


2.583 


2.921 


3.686 


4.015 


17 


0.257 


0.689 


1.333 


1.740 


2.110 


2.567 


2.898 


3.646 


3.965 


18 


0.257 


0.688 


1.330 


1.734 


2.101 


2.552 


2.878 


3.610 


3.922 


19 


0.257 


0.688 


1.328 


1.729 


2.093 


2.539 


2.861 


3.579 


3.883 


20 


0.257 


0.687 


1.325 


1.725 


2.086 


2.528 


2.845 


3.552 


3.850 


25 


0.256 


0.684 


1.316 


1.708 


2.060 


2.485 


2.787 


3.450 


3.725 


50 


0.255 


0.679 


1.299 


1.676 


2.009 


2.403 


2.678 


3.261 


3.496 


100 


0.254 


0.677 


1.290 


1.660 


1.984 


2.364 


2.626 


3.174 


3.390 


oo 


0.253 


0.674 


1.282 


1.645 


1.960 


2.326 


2.576 


3.091 


3.291 
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71 


F = 


U.UUj 


0.010 


U.Uzj 


0.0 jU 


U.10U 


O.zjO 


U.jUU 


0. /jO 


U.90U 


0.950 


u.y / J 


0.990 


0.995 


i 
1 


0.000039 J 


0.0001571 


0.0009821 


0.00393 


0.0158 


0.102 


0.455 


1.32 


2.71 


3.84 


5.02 


6.63 


7.88 



L 


0.0100 


0.0201 


0.0506 


0.103 


0.21 1 


0.575 


1.39 


2.77 


4.61 


5.99 


7.38 


9.21 


10.6 


1 

3 


0.0717 


0.1 15 


0.216 


0.352 


0.584 


1.21 


2.37 


4.1 1 


6.25 


7.81 


9.35 


1 1.3 


12.8 


A 


0.207 


0.297 


0.484 


0.71 1 


1.06 


1.92 


3.36 


5.39 


7.78 


9.49 


11.1 


13.3 


14.9 


D 


0.412 


0.554 


0.831 


1.15 


1.61 


2.67 


4.35 


6.63 


9.24 


11.1 


12.8 


15.1 


16.7 





0.676 


0.872 


1.24 


1.64 


2.20 


3.45 


5.35 


7.84 


10.6 


12.6 


14.4 


16.8 


18.5 


7 
1 


0.989 


1.24 


1.69 


2.17 


2.83 


4.25 


6.35 


9.04 


12.0 


14.1 


16.0 


18.5 


20.3 


Q 
O 


1.34 


1.65 


2.18 


2.73 


3.49 


5.07 


7.34 


10.2 


13.4 


15.5 


17.5 


20.1 


22.0 


Q 


1.73 


2.09 


2.70 


3.33 


4.17 


5.90 


8.34 


1 1.4 


14.7 


16.9 


19.0 


21.7 


23.6 


1 Ci 
1U 


2.16 


2.56 


3.25 


3.94 


4.87 


6.74 


9.34 


12.5 


16.0 


18.3 


20.5 


23.2 


25.2 


1 1 


2.60 


3.05 


3.82 


4.57 


5.58 


7.58 


10.3 


13.7 


17.3 


19.7 


21.9 


24.7 


26.8 


1 9 
1Z 


3.07 


3.57 


4.40 


5.23 


6.30 


8.44 


1 1.3 


14.8 


18.5 


21.0 


23.3 


26.2 


28.3 


1 "3 


3.57 


4.1 1 


5.01 


5.89 


7.04 


9.30 


12.3 


16.0 


19.8 


22.4 


24.7 


27.7 


29.8 


1 /I 
14 


4.07 


4.66 


5.63 


6.57 


7.79 


10.2 


13.3 


17.1 


21.1 


23.7 


26.1 


29.1 


31.3 


1 s 


4.60 


5.23 


6.26 


7.26 


8.55 


11.0 


14.3 


18.2 


22.3 


25.0 


27.5 


30.6 


32.8 


1 f- 
10 


5.14 


5.81 


6.91 


7.96 


9.31 


11.9 


15.3 


19.4 


23.5 


26.3 


28.8 


32.0 


34.3 


1 7 
1 / 


5.70 


6.41 


7.56 


8.67 


10.1 


12.8 


16.3 


20.5 


24.8 


27.6 


30.2 


33.4 


35.7 


1 c 
1 o 


6.26 


7.01 


8.23 


9.39 


10.9 


13.7 


17.3 


21.6 


26.0 


28.9 


31.5 


34.8 


37.2 


1 Q 

iy 


6.84 


7.63 


8.91 


10.1 


1 1.7 


14.6 


18.3 


22.7 


27.2 


30.1 


32.9 


36.2 


38.6 


on 
zU 


7.43 


8.26 


9.59 


10.9 


12.4 


15.5 


19.3 


23.8 


28.4 


31.4 


34.2 


37.6 


40.0 


1 
Zl 


8.03 


8.90 


10.3 


1 1.6 


13.2 


16.3 


20.3 


24.9 


29.6 


32.7 


35.5 


38.9 


41.4 


ZZ 


8.64 


9.54 


1 1.0 


12.3 


14.0 


17.2 


21.3 


26.0 


30.8 


33.9 


36.8 


40.3 


42.8 


Ol 


9 26 


10 2 


117 


13 1 


14 8 


18 1 


22 3 


27 1 


32 


35 2 


38 1 


41 6 


44 2 


24 


9.89 


10.9 


12.4 


13.8 


15.7 


19.0 


23.3 


28.2 


33.2 


36.4 


39.4 


43.0 


45.6 


25 


10.5 


11.5 


13.1 


14.6 


16.5 


19.9 


24.3 


29.3 


34.4 


37.7 


40.6 


44.3 


46.9 


30 


13.8 


15.0 


16.8 


18.5 


20.6 


24.5 


29.3 


34.8 


40.3 


43.8 


47.0 


50.9 


53.7 


35 


17.2 


18.5 


20.6 


22.5 


24.8 


29.1 


34.3 


40.2 


46.1 


49.8 


53.2 


57.3 


60.3 


50 


28.0 


29.7 


32.4 


34.8 


37.7 


42.9 


43.9 


56.3 


63.2 


67.5 


71.4 


76.2 


79.5 



T3 

3 

I 

ft 



00 

c 

H 

o 

Z 



4^ 
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n 


m = 


I 


2 


3 


4 


5 


5 


7 


8 


9 


10 


50 


100 




i 


39.86 


49.50 


53.59 


55.83 


57.24 


58.20 


58.91 


59.44 


59.86 


60.19 


62.69 


63.01 


63.33 


z 


8.53 


9.00 


9.16 


9.24 


9.29 


9.33 


9.35 


9.37 


9.38 


9.39 


9.47 


9.48 


9.49 


3 


5.54 


5.46 


5.39 


5.34 


5.31 


5.28 


5.27 


5.25 


5.24 


5.23 


5.15 


5.14 


5.13 


4 


4.54 


4.32 


4.19 


4.11 


4.05 


4.01 


3.98 


3.95 


3.94 


3.92 


3.80 


3.78 


3.76 


5 


4.06 


3.78 


3.62 


3.52 


3.45 


3.40 


3.37 


3.34 


3.32 


3.30 


3.15 


3.13 


3.10 


6 


3.78 


3.46 


3.29 


3.18 


3.11 


3.05 


3.01 


2.98 


2.96 


2.94 


2.77 


2.75 


2.72 


1 


3.59 


3.26 


3.07 


2.96 


2.88 


2.83 


2.78 


2.75 


2.72 


2.70 


2.52 


2.50 


2.47 


8 


3.46 


3.11 


2.92 


2.81 


2.73 


2.67 


2.62 


2.59 


2.56 


2.54 


2.35 


2.32 


2.29 


9 


3.36 


3.01 


2.81 


2.69 


2.61 


2.55 


2.51 


2.47 


2.44 


2.42 


2.22 


2.19 


2.16 


10 


3.29 


2.92 


2.73 


2.61 


2.52 


2.46 


2.41 


2.38 


2.35 


2.32 


2.12 


2.09 


2.06 


11 


3.23 


2.86 


2.66 


2.54 


2.45 


2.39 


2.34 


2.30 


2.27 


2.25 


2.04 


2.01 


1.97 


1Z 


3.18 


2.81 


2.61 


2.48 


2.39 


2.33 


2.28 


2.24 


2.21 


2.19 


1.97 


1.94 


1.90 


13 


3.14 


2.76 


2.56 


2.43 


2.35 


2.28 


2.23 


2.20 


2.16 


2.14 


1.92 


1.88 


1.85 


14 


3.10 


2.73 


2.52 


2.39 


2.31 


2.24 


2.19 


2.15 


2.12 


2.10 


1.87 


1.83 


1.80 


15 


3.07 


2.70 


2.49 


2.36 


2.27 


2.21 


2.16 


2.12 


2.09 


2.06 


1.83 


1.79 


1.76 


16 


3.05 


2.67 


2.46 


2.33 


2.24 


2.18 


2.13 


2.09 


2.06 


2.03 


1.79 


1.76 


1.72 


1 t 
i / 


3.03 


2.64 


2.44 


2.31 


2.22 


2.15 


2.10 


2.06 


2.03 


2.00 


1.76 


1.73 


1.69 


18 


3.01 


2.62 


2.42 


2.29 


2.20 


2.13 


2.08 


2.04 


2.00 


1.98 


1.74 


1.70 


1.66 


19 


2.99 


2.61 


2.40 


2.27 


2.18 


2.11 


2.06 


2.02 


1.98 


1.96 


1.71 


1.67 


1.63 


20 


2.97 


2.59 


2.38 


2.25 


2.16 


2.09 


2.04 


2.00 


1.96 


1.94 


1.69 


1.65 


1.61 


25 


2.92 


2.53 


2.32 


2.18 


2.09 


2.02 


1.97 


1.93 


1.89 


1.87 


1.61 


1.56 


1.52 


50 


2.81 


2.41 


2.20 


2.06 


1.97 


1.90 


1.84 


1.80 


1.76 


1.73 


1.44 


1.39 


1.34 


100 


2.76 


2.36 


2.14 


2.00 


1.91 


1.83 


1.78 


1.73 


1.69 


1.66 


1.35 


1.29 


1.20 


OG 


2.71 


2.30 


2.08 


1.94 


1.85 


1.77 


1.72 


1.67 


1.63 


1.60 


1.24 


1.17 


1.00 
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n 


m = 


1 


2 


3 


4 


5 




7 


8 


9 


10 


50 


100 




i 


161.4 


199.5 


215.7 


224.6 


230.2 


234.0 


236.8 


238.9 


240.5 


241.9 


251.8 


253.0 


254.3 


z 


18.51 


19.00 


19.16 


19.25 


19.30 


19.33 


19.35 


19.37 


19.38 


19.40 


19.48 


19.49 


19.50 


3 


10.13 


9.55 


9.28 


9.12 


9.01 


8.94 


8.89 


8.85 


8.81 


8.79 


8.58 


8.55 


8.53 


4 


7.71 


6.94 


6.59 


6.39 


6.26 


6.16 


6.09 


6.04 


6.00 


5.96 


5.70 


5.66 


5.63 


5 


6.61 


5.79 


5.41 


5.19 


5.05 


4.95 


4.88 


4.82 


4.77 


4.74 


4.44 


4.41 


4.36 


6 


5.99 


5.14 


4.76 


4.53 


4.39 


4.28 


4.21 


4.15 


4.10 


4.06 


3.75 


3.71 


3.67 


/ 


5.59 


4.74 


4.35 


4.12 


3.97 


3.87 


3.79 


3.73 


3.68 


3.64 


3.32 


3.27 


3.23 


8 


5.32 


4.46 


4.07 


3.84 


3.69 


3.58 


3.50 


3.44 


3.39 


3.35 


3.02 


2.97 


2.93 


9 


5.12 


4.26 


3.86 


3.63 


3.48 


3.37 


3.29 


3.23 


3.18 


3.14 


2.80 


2.76 


2.71 


10 


4.96 


4.10 


3.71 


3.48 


3.33 


3.22 


3.14 


3.07 


3.02 


2.98 


2.64 


2.59 


2.54 


11 


4.84 


3.98 


3.59 


3.36 


3.20 


3.09 


3.01 


2.95 


2.90 


2.85 


2.51 


2.46 


2.40 


1Z 


4.75 


3.89 


3.49 


3.26 


3.11 


3.00 


2.91 


2.85 


2.80 


2.75 


2.40 


2.35 


2.30 


13 


4.67 


3.81 


3.41 


3.18 


3.03 


2.92 


2.83 


2.77 


2.71 


2.67 


2.31 


2.26 


2.21 


14 


4.60 


3.74 


3.34 


3.11 


2.96 


2.85 


2.76 


2.70 


2.65 


2.60 


2.24 


2.19 


2.13 


15 


4.54 


3.68 


3.29 


3.06 


2.90 


2.79 


2.71 


2.64 


2.59 


2.54 


2.18 


2.12 


2.07 


16 


4.49 


3.63 


3.24 


3.01 


2.85 


2.74 


2.66 


2.59 


2.54 


2.49 


2.12 


2.07 


2.01 


i / 


4.45 


3.59 


3.20 


2.96 


2.81 


2.70 


2.61 


2.55 


2.49 


2.45 


2.08 


2.02 


1.96 


18 


4.41 


3.55 


3.16 


2.93 


2.77 


2.66 


2.58 


2.51 


2.46 


2.41 


2.04 


1.98 


1.92 


19 


4.38 


3.52 


3.13 


2.90 


2.74 


2.63 


2.54 


2.48 


2.42 


2.38 


2.00 


1.94 


1.88 


20 


4.35 


3.49 


3.10 


2.87 


2.71 


2.60 


2.51 


2.45 


2.39 


2.35 


1.97 


1.91 


1.84 


25 


4.24 


3.39 


2.99 


2.76 


2.60 


2.49 


2.40 


2.34 


2.28 


2.24 


1.84 


1.78 


1.71 


50 


4.03 


3.18 


2.79 


2.56 


2.40 


2.29 


2.20 


2.13 


2.07 


2.03 


1.60 


1.52 


1.45 


100 


3.94 


3.09 


2.70 


2.46 


2.31 


2.19 


2.10 


2.03 


1.97 


1.93 


1.48 


1.39 


1.28 


oo 


3.84 


3.00 


2.60 


2.37 


2.21 


2.10 


2.01 


1.94 


1.88 


1.83 


1.35 


1.25 


1.00 
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n 


m = 


I 


2 


3 


4 


5 




7 




9 


10 


50 


100 




i 


647.8 


799.5 


864.2 


899.6 


921.8 


937.1 


948.2 


956.7 


963.3 


968.6 


1008 


1013 


1018 


z 


38.51 


39.00 


39.17 


39.25 


39.30 


39.33 


39.36 


39.37 


39.39 


39.40 


39.48 


39.49 


39.50 


3 


17.44 


16.04 


15.44 


15.10 


14.88 


14.73 


14.62 


14.54 


14.47 


14.42 


14.01 


13.96 


13.90 


4 


12.22 


10.65 


9.98 


9.60 


9.36 


9.20 


9.07 


8.98 


8.90 


8.84 


8.38 


8.32 


8.26 


5 


10.01 


8.43 


7.76 


7.39 


7.15 


6.98 


6.85 


6.76 


6.68 


6.62 


6.14 


6.08 


6.02 


6 


8.81 


7.26 


6.60 


6.23 


5.99 


5.82 


5.70 


5.60 


5.52 


5.46 


4.98 


4.92 


4.85 


/ 


8.07 


6.54 


5.89 


5.52 


5.29 


5.12 


4.99 


4.90 


4.82 


4.76 


4.28 


4.21 


4.14 


8 


7.57 


6.06 


5.42 


5.05 


4.82 


4.65 


4.53 


4.43 


4.36 


4.30 


3.81 


3.74 


3.67 


9 


7.21 


5.71 


5.08 


4.72 


4.48 


4.32 


4.20 


4.10 


4.03 


3.96 


3.47 


3.40 


3.33 


10 


6.94 


5.46 


4.83 


4.47 


4.24 


4.07 


3.95 


3.85 


3.78 


3.72 


3.22 


3.15 


3.08 


11 


6.72 


5.26 


4.63 


4.28 


4.04 


3.88 


3.76 


3.66 


3.59 


3.53 


3.03 


2.96 


2.88 


1Z 


6.55 


5.10 


4.47 


4.12 


3.89 


3.73 


3.61 


3.51 


3.44 


3.37 


2.87 


2.80 


2.72 


13 


6.41 


4.97 


4.35 


4.00 


3.77 


3.60 


3.48 


3.39 


3.31 


3.25 


2.74 


2.67 


2.60 


14 


6.30 


4.86 


4.24 


3.89 


3.66 


3.50 


3.38 


3.29 


3.21 


3.15 


2.64 


2.56 


2.49 


15 


6.20 


4.77 


4.15 


3.80 


3.58 


3.41 


3.29 


3.20 


3.12 


3.06 


2.55 


2.47 


2.40 


16 


6.12 


4.69 


4.08 


3.73 


3.50 


3.34 


3.22 


3.12 


3.05 


2.99 


2.47 


2.40 


2.32 


i / 


6.04 


4.62 


4.01 


3.66 


3.44 


3.28 


3.16 


3.06 


2.98 


2.92 


2.41 


2.33 


2.25 


18 


5.98 


4.56 


3.95 


3.61 


3.38 


3.22 


3.10 


3.01 


2.93 


2.87 


2.35 


2.27 


2.19 


19 


5.92 


4.51 


3.90 


3.56 


3.33 


3.17 


3.05 


2.96 


2.88 


2.82 


2.30 


2.22 


2.13 


20 


5.87 


4.46 


3.86 


3.51 


3.29 


3.13 


3.01 


2.91 


2.84 


2.77 


2.25 


2.17 


2.09 


25 


5.69 


4.29 


3.69 


3.35 


3.13 


2.97 


2.85 


2.75 


2.68 


2.61 


2.08 


2.00 


1.91 


50 


5.34 


3.97 


3.39 


3.05 


2.83 


2.67 


2.55 


2.46 


2.38 


2.32 


1.75 


1.66 


1.54 


100 


5.18 


3.83 


3.25 


2.92 


2.70 


2.54 


2.42 


2.32 


2.24 


2.18 


1.59 


1.48 


1.37 


oo 


5.02 


3.69 


3.12 


2.79 


2.57 


2.41 


2.29 


2.19 


2.11 


2.05 


1.43 


1.27 


1.00 
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n 


m = 


I 


2 


3 


4 


5 


5 


7 




9 


10 


50 


100 




i 


4052 


5000 


5403 


5625 


5764 


5859 


5928 


5981 


6022 


6056 


6303 


6334 


6336 


z 


98.50 


99.00 


99.17 


99.25 


99.30 


99.33 


99.36 


99.37 


99.39 


99.40 


99.48 


99.49 


99.50 


3 


34.12 


30.82 


29.46 


28.71 


28.24 


27.91 


27.67 


27.49 


27.35 


27.23 


26.35 


26.24 


26.13 


4 


21.20 


18.00 


16.69 


15.98 


15.52 


15.21 


14.98 


14.80 


14.66 


14.55 


13.69 


13.58 


13.46 


5 


16.26 


13.27 


12.06 


11.39 


10.97 


10.67 


10.46 


10.29 


10.16 


10.05 


9.24 


9.13 


9.02 


6 


13.75 


10.92 


9.78 


9.15 


8.75 


8.47 


8.26 


8.10 


7.98 


7.87 


7.09 


6.99 


6.88 


/ 


12.25 


9.55 


8.45 


7.85 


7.46 


7.19 


6.99 


6.84 


6.72 


6.62 


5.86 


5.75 


5.65 


8 


11.26 


8.65 


7.59 


7.01 


6.63 


6.37 


6.18 


6.03 


5.91 


5.81 


5.07 


4.96 


4.86 


9 


10.56 


8.02 


6.99 


6.42 


6.06 


5.80 


5.61 


5.47 


5.35 


5.26 


4.52 


4.41 


4.31 


10 


10.04 


7.56 


6.55 


5.99 


5.64 


5.39 


5.20 


5.06 


4.94 


4.85 


4.12 


4.01 


3.91 


11 


9.65 


7.21 


6.22 


5.67 


5.32 


5.07 


4.89 


4.74 


4.63 


4.54 


3.81 


3.71 


3.60 


1 9 


9.33 


6.93 


5.95 


5.41 


5.06 


4.82 


4.64 


4.50 


4.39 


4.30 


3.57 


3.47 


3.36 


13 


9.07 


6.70 


5.74 


5.21 


4.86 


4.62 


4.44 


4.30 


4.19 


4.10 


3.38 


3.27 


3.17 


14 


8.86 


6.51 


5.56 


5.04 


4.69 


4.46 


4.28 


4.14 


4.03 


3.94 


3.22 


3.11 


3.00 


15 


8.68 


6.36 


5.42 


4.89 


4.56 


4.32 


4.14 


4.00 


3.89 


3.80 


3.08 


2.98 


2.87 


16 


8.53 


6.23 


5.29 


4.77 


4.44 


4.20 


4.03 


3.89 


3.78 


3.69 


2.97 


2.86 


2.75 


i / 


8.40 


6.11 


5.18 


4.67 


4.34 


4.10 


3.93 


3.79 


3.68 


3.59 


2.87 


2.76 


2.65 


18 


8.29 


6.01 


5.09 


4.58 


4.25 


4.01 


3.84 


3.71 


3.60 


3.51 


2.78 


2.68 


2.57 


19 


8.18 


5.93 


5.01 


4.50 


4.17 


3.94 


3.77 


3.63 


3.52 


3.43 


2.71 


2.60 


2.49 


20 


8.10 


5.85 


4.94 


4.43 


4.10 


3.87 


3.70 


3.56 


3.46 


3.37 


2.64 


2.54 


2.42 


25 


7.77 


5.57 


4.68 


4.18 


3.85 


3.63 


3.46 


3.32 


3.22 


3.13 


2.40 


2.29 


2.17 


50 


7.17 


5.06 


4.20 


3.72 


3.41 


3.19 


3.02 


2.89 


2.78 


2.70 


1.95 


1.82 


1.70 


100 


6.90 


4.82 


3.98 


3.51 


3.21 


2.99 


2.82 


2.69 


2.59 


2.50 


1.74 


1.60 


1.45 


oo 


6.63 


4.61 


3.78 


3.32 


3.02 


2.80 


2.64 


2.51 


2.41 


2.32 


1.53 


1.32 


1.00 
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n 


m = 


I 


2 


3 


4 


5 




7 




9 


10 


50 


100 




i 


1621 1 


20000 


21615 


22500 


23056 


23437 


23715 


23925 


24091 


24224 


2521 1 


25337 


25465 


z 


198.5 


199.0 


199.2 


199.2 


199.3 


199.3 


199.4 


199.4 


199.4 


199.4 


199.5 


199.5 


199.5 


3 


55.55 


49.80 


47.47 


46.19 


45.39 


44.84 


44.43 


44.13 


43.88 


43.69 


42.21 


42.02 


41.83 


4 


31.33 


26.28 


24.26 


23.15 


22.46 


21.97 


21.62 


21.35 


21.14 


20.97 


19.67 


19.50 


19.32 


5 


22.78 


18.31 


16.53 


15.56 


14.94 


14.51 


14.20 


13.96 


13.77 


13.62 


12.45 


12.30 


12.14 


6 


18.63 


14.54 


12.92 


12.03 


1 1.46 


1 1.07 


10.79 


10.57 


10.39 


10.25 


9.17 


9.03 


8.88 


1 


16.24 


12.40 


10.88 


10.05 


9.52 


9.16 


8.89 


8.68 


8.51 


8.38 


7.35 


7.22 


7.08 


8 


14.69 


11.04 


9.60 


8.81 


8.30 


7.95 


7.69 


7.50 


7.34 


7.21 


6.22 


6.09 


5.95 


9 


13.61 


10.11 


8.72 


7.96 


7.47 


7.13 


6.88 


6.69 


6.54 


6.42 


5.45 


5.32 


5.19 


10 


12.83 


9.43 


8.08 


7.34 


6.87 


6.54 


6.30 


6.12 


5.97 


5.85 


4.90 


4.77 


4.64 


11 


12.23 


8.91 


7.60 


6.88 


6.42 


6.10 


5.86 


5.68 


5.54 


5.42 


4.49 


4.36 


4.23 




11.75 


8.51 


7.23 


6.52 


6.07 


5.76 


5.52 


5.35 


5.20 


5.09 


4.17 


4.04 


3.90 


13 


11.37 


8.19 


6.93 


6.23 


5.79 


5.48 


5.25 


5.08 


4.94 


4.82 


3.91 


3.78 


3.65 


14 


11.06 


7.92 


6.68 


6.00 


5.56 


5.26 


5.03 


4.86 


4.72 


4.60 


3.70 


3.57 


3.44 


15 


10.80 


7.70 


6.48 


5.80 


5.37 


5.07 


4.85 


4.67 


4.54 


4.42 


3.52 


3.39 


3.26 


16 


10.58 


7.51 


6.30 


5.64 


5.21 


4.91 


4.69 


4.52 


4.38 


4.27 


3.37 


3.25 


3.1 1 


i / 


10.38 


7.35 


6.16 


5.50 


5.07 


4.78 


4.56 


4.39 


4.25 


4.14 


3.25 


3.12 


2.98 


18 


10.22 


7.21 


6.03 


5.37 


4.96 


4.66 


4.44 


4.28 


4.14 


4.03 


3.14 


3.01 


2.87 


19 


10.07 


7.09 


5.92 


5.27 


4.85 


4.56 


4.34 


4.18 


4.04 


3.93 


3.04 


2.91 


2.78 


20 


9.94 


6.99 


5.82 


5.17 


4.76 


4.47 


4.26 


4.09 


3.96 


3.85 


2.96 


2.83 


2.69 


25 


9.48 


6.60 


5.46 


4.84 


4.43 


4.15 


3.94 


3.78 


3.64 


3.54 


2.65 


2.52 


2.38 


50 


8.63 


5.90 


4.83 


4.23 


3.85 


3.58 


3.38 


3.22 


3.09 


2.99 


2.10 


1.95 


1.81 


100 


8.24 


5.59 


4.54 


3.96 


3.59 


3.33 


3.13 


2.97 


2.85 


2.74 


1.84 


1.68 


1.51 


oo 


7.88 


5.30 


4.28 


3.72 


3.35 


3.09 


2.90 


2.74 


2.62 


2.52 


1.60 


1.36 


1.00 
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n 


m = 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


50 


100 


oo 


2 


998.5 


999.0 


999.2 


999.2 


999.3 


999.3 


999.4 


999.4 


999.4 


999.4 


999.5 


999.5 


999.5 


3 


167.0 


148.5 


141.1 


137.1 


134.6 


132.8 


131.6 


130.6 


129.9 


129.2 


124.7 


124.1 


123.5 


4 


74.14 


61.25 


56.18 


53.44 


51.71 


50.53 


49.66 


49.00 


48.47 


48.05 


44.88 


44.47 


44.05 


5 


47.18 


37.12 


33.20 


31.09 


29.75 


28.83 


28.16 


27.65 


27.24 


26.92 


24.44 


24.12 


23.79 


6 


35.51 


27.00 


23.70 


21.92 


20.80 


20.03 


19.46 


19.03 


18.69 


18.41 


16.31 


16.03 


15.75 


7 


29.25 


21.69 


18.77 


17.20 


16.21 


15.52 


15.02 


14.63 


14.33 


14.08 


12.20 


11.95 


11.70 


8 


25.41 


18.49 


15.83 


14.39 


13.48 


12.86 


12.40 


12.05 


11.77 


11.54 


9.80 


9.57 


9.33 


9 


22.86 


16.39 


13.90 


12.56 


11.71 


11.13 


10.70 


10.37 


10.11 


9.89 


8.26 


8.04 


7.81 


10 


21.04 


14.91 


12.55 


11.28 


10.48 


9.93 


9.52 


9.20 


8.96 


8.75 


7.19 


6.98 


6.76 


11 


19.69 


13.81 


11.56 


10.35 


9.58 


9.05 


8.66 


8.35 


8.12 


7.92 


6.42 


6.21 


6.00 


12 


18.64 


12.97 


10.80 


9.63 


8.89 


8.38 


8.00 


7.71 


7.48 


7.29 


5.83 


5.63 


5.42 


13 


17.82 


12.31 


10.21 


9.07 


8.35 


7.86 


7.49 


7.21 


6.98 


6.80 


5.37 


5.17 


4.97 


14 


17.14 


11.78 


9.73 


8.62 


7.92 


7.44 


7.08 


6.80 


6.58 


6.40 


5.00 


4.81 


4.60 


15 


16.59 


11.34 


9.34 


8.25 


7.57 


7.09 


6.74 


6.47 


6.26 


6.08 


4.70 


4.51 


4.31 


16 


16.12 


10.97 


9.01 


7.94 


7.27 


6.80 


6.46 


6.19 


5.98 


5.81 


4.45 


4.26 


4.06 


17 


15.72 


10.66 


8.73 


7.68 


7.02 


6.56 


6.22 


5.96 


5.75 


5.58 


4.24 


4.05 


3.85 


18 


15.38 


10.39 


8.49 


7.46 


6.81 


6.35 


6.02 


5.76 


5.56 


5.39 


4.06 


3.87 


3.67 


19 


15.08 


10.16 


8.28 


7.27 


6.62 


6.18 


5.85 


5.59 


5.39 


5.22 


3.90 


3.71 


3.51 


20 


14.82 


9.95 


8.10 


7.10 


6.46 


6.02 


5.69 


5.44 


5.24 


5.08 


3.77 


3.58 


3.38 


25 


13.88 


9.22 


7.45 


6.49 


5.89 


5.46 


5.15 


4.91 


4.71 


4.56 


3.28 


3.09 


2.89 


50 


12.22 


7.96 


6.34 


5.46 


4.90 


4.51 


4.22 


4.00 


3.82 


3.67 


2.44 


2.25 


2.06 


100 


11.50 


7.41 


5.86 


5.02 


4.48 


4.11 


3.83 


3.61 


3.44 


3.30 


2.08 


1.87 


1.65 


oo 


10.83 


6.91 


5.42 


4.62 


4.10 


3.74 


3.47 


3.27 


3.10 


2.96 


1.75 


1.45 


1.00 
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7.14.6 CUMULATIVE TERMS, BINOMIAL DISTRIBUTION 



B(n,x;p) = J2^jp k (l - P) n - k - 

Notefhat£?(n,a;;p) = B(n,n — x; 1 — p). 

If p is the probability of success, then B(n, x; p) is the probability of x or fewer 
successes in n independent trials. For example, if a biased coin has a probability 
p = 0.4 of being a head, and the coin is independently ipped 5 times, then there is 
a 68% chance that there will be 2 or fewer heads (since B(5, 2; 0.4) = 0.6826). 



n 


X 


P 


a 

U.U5 


a 1 a 


a 1 c 
(J. 15 


U.2U 


0.25 


n in 
U. jU 


n Art 


n cn 


L 


U 


0.9025 


0.8100 


0.7225 


0.6400 


0.5625 


U.49UU 


0.3600 


0.2500 




i 
1 


0.9975 


r\ aaaa 

U.990U 


0.9775 


0.9600 


0.9375 


0.9100 


U.840U 


0.7500 


3 





0.8574 


0.7290 


0.6141 


0.5120 


0.4219 


0.3430 


0.2160 


0.1250 




l 


0.9928 


0.9720 


0.9393 


0.8960 


0.8438 


0.7840 


0.6480 


0.5000 




2 


0.9999 


0.9990 


0.9966 


0.9920 


r\ no a a 

0.9844 


0.9730 


0.9360 


0.8750 


4 





0.8145 


0.6561 


0.5220 


0.4096 


0.3164 


0.2401 


0.1296 


0.0625 




1 


0.9860 


0.9477 


0.8905 


0.8192 


0.7383 


0.6517 


0.4752 


0.3125 




2 


0.9995 


0.9963 


0.9880 


0.9728 


0.9492 


0.9163 


0.8208 


0.6875 




3 


1.0000 


0.9999 


0.9995 


0.9984 


0.9961 


0.9919 


0.9744 


0.9375 






0.7738 


0.5905 


0.4437 


0.3277 


0.2373 


0.1681 


0.0778 


0.0312 




1 


0.9774 


0.9185 


0.8352 


0.7373 


0.6328 


0.5282 


0.3370 


0.1875 




2 


0.9988 


0.9914 


0.9734 


0.9421 


0.8965 


0.8369 


0.6826 


0.5000 




3 


1.0000 


0.9995 


0.9978 


0.9933 


0.9844 


0.9692 


0.9130 


0.8125 




4 


1.0000 


1.0000 


0.9999 


0.9997 


0.9990 


0.9976 


0.9898 


0.9688 


6 





0.7351 


0.5314 


0.3771 


0.2621 


0.1780 


0.1177 


0.0467 


0.0156 




1 


0.9672 


0.8857 


0.7765 


0.6554 


0.5339 


0.4202 


0.2333 


0.1094 




2 


0.9978 


0.9841 


0.9527 


0.9011 


0.8306 


0.7443 


0.5443 


0.3438 




3 


0.9999 


0.9987 


0.9941 


0.9830 


0.9624 


0.9295 


0.8208 


0.6562 




4 


1.0000 


1.0000 


0.9996 


0.9984 


0.9954 


0.9891 


0.9590 


0.8906 




5 


1.0000 


1.0000 


1.0000 


0.9999 


0.9998 


0.9993 


0.9959 


0.9844 


7 





0.6983 


0.4783 


0.3206 


0.2097 


0.1335 


0.0824 


0.0280 


0.0078 




1 


0.9556 


0.8503 


0.7166 


0.5767 


0.4450 


0.3294 


0.1586 


0.0625 




2 


0.9962 


0.9743 


0.9262 


0.8520 


0.7564 


0.6471 


0.4199 


0.2266 




3 


0.9998 


0.9973 


0.9879 


0.9667 


0.9294 


0.8740 


0.7102 


0.5000 




4 


1.0000 


0.9998 


0.9988 


0.9953 


0.9871 


0.9712 


0.9037 


0.7734 




5 


1.0000 


1.0000 


0.9999 


0.9996 


0.9987 


0.9962 


0.9812 


0.9375 




6 


1.0000 


1.0000 


1.0000 


1.0000 


0.9999 


0.9998 


0.9984 


0.9922 
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n 


X 


P 


0.05 


0.10 


0.15 


0.20 


0.25 


0.30 


0.40 


0.50 


8 





0.6634 


0.4305 


0.2725 


0.1678 


0.1001 


0.0576 


0.0168 


0.0039 




1 


0.9428 


0.8131 


0.6572 


0.5033 


0.3671 


0.2553 


0.1064 


0.0352 




2 


0.9942 


0.9619 


0.8948 


0.7969 


0.6785 


0.5518 


0.3154 


0.1445 






0.9996 


0.9950 


0.9787 


0.9437 


0.8862 


0.8059 


0.5941 


3633 




4 


1.0000 


0.9996 


0.9971 


0.9896 


0.9727 


0.9420 


0.8263 


0.6367 




5 


1.0000 


1.0000 


0.9998 


0.9988 


0.9958 


0.9887 


0.9502 


0.8555 




6 


1.0000 


1.0000 


1.0000 


0.9999 


0.9996 


0.9987 


0.9915 


0.9648 




7 


1.0000 


1.0000 


1.0000 


1 .0000 


1.0000 


0.9999 


0.9993 


0.9961 


9 





0.6302 


0.3874 


0.2316 


0.1342 


0.0751 


0.0403 


0.0101 


0.0019 




1 


0.9288 


0.7748 


0.5995 


0.4362 


0.3003 


0.1960 


0.0705 


0.0195 




2 


0.9916 


0.9470 


0.8591 


0.7382 


0.6007 


0.4628 


0.2318 


0.0898 




3 


0.9994 


0.9917 


0.9661 


0.9144 


0.8343 


0.7297 


0.4826 


0.2539 




4 


1.0000 


0.9991 


0.9944 


0.9804 


0.9511 


0.9012 


0.7334 


0.5000 




5 


1.0000 


0.9999 


0.9994 


0.9969 


0.9900 


0.9747 


0.9006 


0.7461 




6 


1.0000 


1.0000 


1.0000 


0.9997 


0.9987 


0.9957 


0.9750 


0.9102 




7 


1.0000 


1.0000 


1.0000 


1.0000 


0.9999 


0.9996 


0.9962 


0.9805 




8 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


0.9997 


0.9980 


10 





0.5987 


0.3487 


0.1969 


0.1074 


0.0563 


0.0283 


0.0060 


0.0010 




1 


0.9139 


0.7361 


0.5443 


0.3758 


0.2440 


0.1493 


0.0464 


0.0107 




2 


0.9885 


0.9298 


0.8202 


0.6778 


0.5256 


0.3828 


0.1673 


0.0547 




3 


0.9990 


0.9872 


0.9500 


0.8791 


0.7759 


0.6496 


0.3823 


0.1719 




4 


0.9999 


0.9984 


0.9901 


0.9672 


0.9219 


0.8497 


0.6331 


0.3770 




c 

J 


1.0000 


0.9999 


0.9986 


0.9936 


0.9803 


0.9526 


0.8338 


0.6230 




6 


1.0000 


1.0000 


0.9999 


0.9991 


0.9965 


0.9894 


0.9452 


0.8281 




7 


1.0000 


1.0000 


1.0000 


0.9999 


0.9996 


0.9984 


0.9877 


0.9453 




8 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


0.9999 


0.9983 


0.9893 




9 


1.0000 


1.0000 


1.0000 


1 .0000 


1.0000 


1 .0000 


0.9999 


0.9990 


11 





0.5688 


0.3138 


0.1673 


0.0859 


0.0422 


0.0198 


0.0036 


0.0005 




1 


0.8981 


0.6974 


0.4922 


0.3221 


0.1971 


0.1130 


0.0302 


0.0059 




2 


0.9848 


0.9104 


0.7788 


0.6174 


0.4552 


0.3127 


0.1189 


0.0327 




3 


0.9984 


0.9815 


0.9306 


0.8389 


0.7133 


0.5696 


0.2963 


0.1133 




4 


0.9999 


0.9972 


0.9841 


0.9496 


0.8854 


0.7897 


0.5328 


0.2744 




5 


1.0000 


0.9997 


0.9973 


0.9883 


0.9657 


0.9218 


0.7535 


0.5000 




6 


1.0000 


1.0000 


0.9997 


0.9980 


0.9924 


0.9784 


0.9006 


0.7256 




7 


1.0000 


1.0000 


1.0000 


0.9998 


0.9988 


0.9957 


0.9707 


0.8867 




8 


1.0000 


1.0000 


1.0000 


1.0000 


0.9999 


0.9994 


0.9941 


0.9673 




9 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


0.9993 


0.9941 




10 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


0.9995 
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n 


X 


P 


0.05 


0.10 


0.15 


0.20 


0.25 


0.30 


0.40 


0.50 


12 





0.5404 


0.2824 


0.1422 


0.0687 


0.0317 


0.0138 


0.0022 


0.0002 




1 


0.8816 


0.6590 


0.4435 


0.2749 


0.1584 


0.0850 


0.0196 


0.0032 




2 


0.9804 


0.8891 


0.7358 


0.5584 


0.3907 


0.2528 


0.0834 


0.0193 




3 


0.9978 


0.9744 


0.9078 


0.7946 


0.6488 


0.4925 


0.2253 


0.0730 




4 


0.9998 


0.9957 


0.9761 


0.9274 


0.8424 


0.7237 


0.4382 


0.1938 




5 


1.0000 


0.9995 


0.9954 


0.9806 


0.9456 


0.8821 


0.6652 


0.3872 




6 


1.0000 


1.0000 


0.9993 


0.9961 


0.9858 


0.9614 


0.8418 


0.6128 




n 

1 


1.0000 


1.0000 


0.9999 


0.9994 


0.9972 


0.9905 


0.9427 


0.8062 




8 


1.0000 


1.0000 


1.0000 


0.9999 


0.9996 


0.9983 


0.9847 


0.9270 




9 


1.0000 


1.0000 


1.0000 


1 .0000 


1.0000 


0.9998 


0.9972 


0.9807 




10 


1 .0000 


1.0000 


1 .0000 


1 .0000 


1 .0000 


1 .0000 


0.9997 


0.9968 




11 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


0.9998 


13 





0.5133 


0.2542 


0.1209 


0.0550 


0.0238 


0.0097 


0.0013 


0.0001 




1 


0.8646 


0.6213 


0.3983 


0.2336 


0.1267 


0.0637 


0.0126 


0.0017 




2 


0.9755 


0.8661 


0.6920 


0.5017 


0.3326 


0.2025 


0.0579 


0.0112 




3 


0.9969 


0.9658 


0.8820 


0.7473 


0.5843 


0.4206 


0.1686 


0.0461 




4 


0.9997 


0.9935 


0.9658 


0.9009 


0.7940 


0.6543 


0.3530 


0.1334 




5 


1.0000 


0.9991 


0.9925 


0.9700 


0.9198 


0.8346 


0.5744 


0.2905 




6 


1.0000 


0.9999 


0.9987 


0.9930 


0.9757 


0.9376 


0.7712 


0.5000 




7 


1.0000 


1.0000 


0.9998 


0.9988 


0.9943 


0.9818 


0.9023 


0.7095 




8 


1.0000 


1.0000 


1.0000 


0.9998 


0.9990 


0.9960 


0.9679 


0.8666 




9 


1.0000 


1.0000 


1.0000 


1.0000 


0.9999 


0.9993 


0.9922 


0.9539 




10 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


0.9999 


0.9987 


0.9888 




11 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


0.9999 


0.9983 




12 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


1.0000 


0.9999 



7.14.7 CUMULATIVE TERMS, POISSON DISTRIBUTION 

If A is the rate of Poisson arrivals, then F(x; A) is the probability of x or fewer 
arrivals occurring in a unit of time. For example, if customers arrive at the rate of 
A = 0.5 customers per hour, then the probability of having no customers in any 
speci ed hour is 0.61 (the probability of one or fewer customers is 0.91). 



A 


X 





1 


2 


3 


4 


5 


6 


7 


8 


9 


0.02 


0.980 


1.000 


















0.04 


0.961 


0.999 


1.000 
















0.06 


0.942 


0.998 


1.000 
















0.08 


0.923 


0.997 


1.000 
















0.10 


0.905 


0.995 


1.000 
















0.15 


0.861 


0.990 


1.000 


1.000 














0.20 


0.819 


0.983 


0.999 


1.000 














0.25 


0.779 


0.974 


0.998 


1.000 














0.30 


0.741 


0.963 


0.996 


1.000 
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A 


X 





1 


2 


3 


4 


5 


6 


7 


8 


9 


0.35 


0.705 


0.951 


0.995 


1.000 














U.'+U 


0.670 


0.938 


0.992 


0.999 


1.000 












0.45 


0.638 


0.925 


0.989 


0.999 


1.000 












0.50 


0.607 


0.910 


0.986 


0.998 


1.000 












0.55 


0.577 


0.894 


0.982 


0.998 


1.000 












0.60 


0.549 


0.878 


0.977 


0.997 


1.000 












U.OO 


0.522 


0.861 


0.972 


0.996 


0.999 


1.000 










0.70 


0.497 


0.844 


0.966 


0.994 


0.999 


1.000 










0.75 


0.472 


0.827 


0.960 


0.993 


0.999 


1.000 










0.80 


0.449 


0.809 


0.953 


0.991 


0.999 


1.000 










0.85 


0.427 


0.791 


0.945 


0.989 


0.998 


1.000 










n on 


0.407 


0.772 


0.937 


0.987 


0.998 


1.000 










0.95 


0.387 


0.754 


0.929 


0.984 


0.997 


1.000 










1.00 


0.368 


0.736 


0.920 


0.981 


0.996 


0.999 


1.000 








1.1 


0.333 


0.699 


0.900 


0.974 


0.995 


0.999 


1.000 








1.2 


0.301 


0.663 


0.879 


0.966 


0.992 


0.999 


1.000 








l. j 


0.273 


0.627 


0.857 


0.957 


0.989 


0.998 


1.000 








1.4 


0.247 


0.592 


0.834 


0.946 


0.986 


0.997 


0.999 


1.000 






1.5 


0.223 


0.558 


0.809 


0.934 


0.981 


0.996 


0.999 


1.000 






1.6 


0.202 


0.525 


0.783 


0.921 


0.976 


0.994 


0.999 


1.000 






1.7 


0.183 


0.493 


0.757 


0.907 


0.970 


0.992 


0.998 


1.000 






1 Q 

1.(5 


0.165 


0.463 


0.731 


0.891 


0.964 


0.990 


0.997 


0.999 


1.000 




1.9 


0.150 


0.434 


0.704 


0.875 


0.956 


0.987 


0.997 


0.999 


1.000 




2.0 


0.135 


0.406 


0.677 


0.857 


0.947 


0.983 


0.996 


0.999 


1.000 




2.2 


0.111 


0.355 


0.623 


0.819 


0.927 


0.975 


0.993 


0.998 


1.000 




2.4 


0.091 


0.308 


0.570 


0.779 


0.904 


0.964 


0.988 


0.997 


0.999 


1.000 


z.o 


0.074 


0.267 


0.518 


0.736 


0.877 


0.951 


0.983 


0.995 


0.999 


1.000 


2.8 


0.061 


0.231 


0.469 


0.692 


0.848 


0.935 


0.976 


0.992 


0.998 


0.999 


3.0 


0.050 


0.199 


0.423 


0.647 


0.815 


0.916 


0.967 


0.988 


0.996 


0.999 


3.2 


0.041 


0.171 


0.380 


0.603 


0.781 


0.895 


0.955 


0.983 


0.994 


0.998 


3.4 


0.033 


0.147 


0.340 


0.558 


0.744 


0.871 


0.942 


0.977 


0.992 


0.997 


A 
J.V 


0.027 


0.126 


0.303 


0.515 


0.706 


0.844 


0.927 


0.969 


0.988 


0.996 


3.8 


0.022 


0.107 


0.269 


0.473 


0.668 


0.816 


0.909 


0.960 


0.984 


0.994 


4.0 


0.018 


0.092 


0.238 


0.433 


0.629 


0.785 


0.889 


0.949 


0.979 


0.992 


4.2 


0.015 


0.078 


0.210 


0.395 


0.590 


0.753 


0.868 


0.936 


0.972 


0.989 


4.4 


0.012 


0.066 


0.185 


0.359 


0.551 


0.720 


0.844 


0.921 


0.964 


0.985 


4.6 


0.010 


0.056 


0.163 


0.326 


0.513 


0.686 


0.818 


0.905 


0.955 


0.981 


4.8 


0.008 


0.048 


0.142 


0.294 


0.476 


0.651 


0.791 


0.887 


0.944 


0.975 


5.0 


0.007 


0.040 


0.125 


0.265 


0.441 


0.616 


0.762 


0.867 


0.932 


0.968 


5.2 


0.005 


0.034 


0.109 


0.238 


0.406 


0.581 


0.732 


0.845 


0.918 


0.960 


5.4 


0.004 


0.029 


0.095 


0.213 


0.373 


0.546 


0.702 


0.822 


0.903 


0.951 
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0.004 


0.024 


0.082 


0.191 


0.342 


0.512 


0.670 


0.797 


0.886 


0.941 


5.8 


0.003 


0.021 


0.071 


0.170 


0.313 


0.478 


0.638 


0.771 


0.867 


0.929 


6.0 


0.003 


0.017 


0.062 


0.151 


0.285 


0.446 


0.606 


0.744 


0.847 


0.916 


6.2 


0.002 


0.015 


0.054 


0.134 


0.259 


0.414 


0.574 


0.716 


0.826 


0.902 


6.4 


0.002 


0.012 


0.046 


0.119 


0.235 


0.384 


0.542 


0.687 


0.803 


0.886 


A A 
0.0 


0.001 


0.010 


0.040 


0.105 


0.213 


0.355 


0.511 


0.658 


0.780 


0.869 


6.8 


0.001 


0.009 


0.034 


0.093 


0.192 


0.327 


0.480 


0.628 


0.755 


0.850 


7.0 


0.001 


0.007 


0.030 


0.082 


0.173 


0.301 


0.450 


0.599 


0.729 


0.831 


7.2 


0.001 


0.006 


0.025 


0.072 


0.155 


0.276 


0.420 


0.569 


0.703 


0.810 


7.4 


0.001 


0.005 


0.022 


0.063 


0.140 


0.253 


0.392 


0.539 


0.676 


0.788 


/.o 


0.001 


0.004 


0.019 


0.055 


0.125 


0.231 


0.365 


0.510 


0.648 


0.765 


7.8 


0.000 


0.004 


0.016 


0.049 


0.112 


0.210 


0.338 


0.481 


0.620 


0.741 


8.0 


0.000 


0.003 


0.014 


0.042 


0.100 


0.191 


0.313 


0.453 


0.593 


0.717 


8.5 


0.000 


0.002 


0.009 


0.030 


0.074 


0.150 


0.256 


0.386 


0.523 


0.653 


9.0 


0.000 


0.001 


0.006 


0.021 


0.055 


0.116 


0.207 


0.324 


0.456 


0.587 


Q ^ 


0.000 


0.001 


0.004 


0.015 


0.040 


0.088 


0.165 


0.269 


0.392 


0.522 


10.0 


0.000 


0.001 


0.003 


0.010 


0.029 


0.067 


0.130 


0.220 


0.333 


0.458 


10.5 


0.000 


0.000 


0.002 


0.007 


0.021 


0.050 


0.102 


0.178 


0.279 


0.397 


11.0 


0.000 


0.000 


0.001 


0.005 


0.015 


0.037 


0.079 


0.143 


0.232 


0.341 


11.5 


0.000 


0.000 


0.001 


0.003 


0.011 


0.028 


0.060 


0.114 


0.191 


0.289 


1Z.U 


0.000 


0.000 


0.001 


0.002 


0.008 


0.020 


0.046 


0.089 


0.155 


0.242 


12.5 


0.000 


0.000 


0.000 


0.002 


0.005 


0.015 


0.035 


0.070 


0.125 


0.201 


13.0 


0.000 


0.000 


0.000 


0.001 


0.004 


0.011 


0.026 


0.054 


0.100 


0.166 


13.5 


0.000 


0.000 


0.000 


0.001 


0.003 


0.008 


0.019 


0.042 


0.079 


0.135 


14.0 


0.000 


0.000 


0.000 


0.001 


0.002 


0.005 


0.014 


0.032 


0.062 


0.109 


14.5 


0.000 


0.000 


0.000 


0.000 


0.001 


0.004 


0.011 


0.024 


0.048 


0.088 


15.0 


0.000 


0.000 


0.000 


0.000 


0.001 


0.003 


0.008 


0.018 


0.037 


0.070 



A 


X 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


2.8 


1.000 




















3.0 


1.000 




















3.2 


1.000 




















3.4 


0.999 


1.000 


















3.6 


0.999 


1.000 


















3.8 


0.998 


0.999 


1.000 
















4.0 


0.997 


0.999 


1.000 
















4.2 


0.996 


0.999 


1.000 
















4.4 


0.994 


0.998 


0.999 


1.000 














4.6 


0.992 


0.997 


0.999 


1.000 














4.8 


0.990 


0.996 


0.999 


1.000 














5.0 


0.986 


0.995 


0.998 


0.999 


1.000 












5.2 


0.982 


0.993 


0.997 


0.999 


1.000 












5.4 


0.978 


0.990 


0.996 


0.999 


1.000 












5.6 


0.972 


0.988 


0.995 


0.998 


0.999 


1.000 
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lo 
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D.o 


0.965 


0.984 


0.993 


0.997 


0.999 


1.000 










6.0 


0.957 


0.980 


0.991 


0.996 


0.999 


1.000 


1.000 








6.2 


0.949 


0.975 


0.989 


0.995 


0.998 


0.999 


1.000 








6.4 


0.939 


0.969 


0.986 


0.994 


0.997 


0.999 


1.000 








6.6 


0.927 


0.963 


0.982 


0.992 


0.997 


0.999 


1.000 


1.000 






0.(5 


0.915 


0.955 


0.978 


0.990 


0.996 


0.998 


0.999 


1.000 






7.0 


0.901 


0.947 


0.973 


0.987 


0.994 


0.998 


0.999 


1.000 






7.2 


0.887 


0.937 


0.967 


0.984 


0.993 


0.997 


0.999 


1.000 






7.4 


0.871 


0.926 


0.961 


0.981 


0.991 


0.996 


0.998 


0.999 


1.000 




7.6 


0.854 


0.915 


0.954 


0.976 


0.989 


0.995 


0.998 


0.999 


1.000 




7 2 
/ .o 


0.835 


0.902 


0.945 


0.971 


0.986 


0.993 


0.997 


0.999 


1.000 




8.0 


0.816 


0.888 


0.936 


0.966 


0.983 


0.992 


0.996 


0.998 


0.999 


1.000 


8.5 


0.763 


0.849 


0.909 


0.949 


0.973 


0.986 


0.993 


0.997 


0.999 


1.000 


9.0 


0.706 


0.803 


0.876 


0.926 


0.959 


0.978 


0.989 


0.995 


0.998 


0.999 


9.5 


0.645 


0.752 


0.836 


0.898 


0.940 


0.967 


0.982 


0.991 


0.996 


0.998 


1U.U 


0.583 


0.697 


0.792 


0.865 


0.916 


0.951 


0.973 


0.986 


0.993 


0.997 


10.5 


0.521 


0.639 


0.742 


0.825 


0.888 


0.932 


0.960 


0.978 


0.989 


0.994 


11.0 


0.460 


0.579 


0.689 


0.781 


0.854 


0.907 


0.944 


0.968 


0.982 


0.991 


11.5 


0.402 


0.520 


0.633 


0.733 


0.815 


0.878 


0.924 


0.954 


0.974 


0.986 


12.0 


0.347 


0.462 


0.576 


0.681 


0.772 


0.844 


0.899 


0.937 


0.963 


0.979 


12. J 


0.297 


0.406 


0.519 


0.628 


0.725 


0.806 


0.869 


0.916 


0.948 


0.969 


13.0 


0.252 


0.353 


0.463 


0.573 


0.675 


0.764 


0.836 


0.890 


0.930 


0.957 


13.5 


0.211 


0.304 


0.409 


0.518 


0.623 


0.718 


0.797 


0.861 


0.908 


0.942 


14.0 


0.176 


0.260 


0.358 


0.464 


0.570 


0.669 


0.756 


0.827 


0.883 


0.923 


14.5 


0.145 


0.220 


0.311 


0.412 


0.518 


0.619 


0.711 


0.790 


0.853 


0.901 


15.0 


0.118 


0.185 


0.268 


0.363 


0.466 


0.568 


0.664 


0.749 


0.820 


0.875 



A 


X 


20 


21 


22 


23 


24 


25 


26 


27 


28 


29 


8.5 


1.000 




















9.0 


1.000 




















9.5 


0.999 


1.000 


















10.0 


0.998 


0.999 


1.000 
















10.5 


0.997 


0.999 


0.999 


1.000 














11.0 


0.995 


0.998 


0.999 


1.000 














11.5 


0.993 


0.996 


0.998 


0.999 


1.000 












12.0 


0.988 


0.994 


0.997 


0.999 


0.999 


1.000 










12.5 


0.983 


0.991 


0.995 


0.998 


0.999 


0.999 


1.000 








13.0 


0.975 


0.986 


0.992 


0.996 


0.998 


0.999 


1.000 








13.5 


0.965 


0.980 


0.989 


0.994 


0.997 


0.998 


0.999 


1.000 






14.0 


0.952 


0.971 


0.983 


0.991 


0.995 


0.997 


0.999 


0.999 


1.000 




14.5 


0.936 


0.960 


0.976 


0.986 


0.992 


0.996 


0.998 


0.999 


1.000 


1.000 


15.0 


0.917 


0.947 


0.967 


0.981 


0.989 


0.994 


0.997 


0.998 


0.999 


1.000 
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1Z 


13 


1 A 

14 


1 a 


0.001 


0.004 


0.010 


0.022 


0.043 


0.077 


0.127 


0.193 


0.275 


0.367 


17 


0.001 


0.002 


0.005 


0.013 


0.026 


0.049 


0.085 


0.135 


0.201 


0.281 


18 


0.000 


0.001 


0.003 


0.007 


0.015 


0.030 


0.055 


0.092 


0.143 


0.208 


19 


0.000 


0.001 


0.002 


0.004 


0.009 


0.018 


0.035 


0.061 


0.098 


0.150 


20 


0.000 


0.000 


0.001 


0.002 


0.005 


0.011 


0.021 


0.039 


0.066 


0.105 


Zl 


0.000 


0.000 


0.000 


0.001 


0.003 


0.006 


0.013 


0.025 


0.043 


0.072 


22 


0.000 


0.000 


0.000 


0.001 


0.002 


0.004 


0.008 


0.015 


0.028 


0.048 


23 


0.000 


0.000 


0.000 


0.000 


0.001 


0.002 


0.004 


0.009 


0.017 


0.031 


24 


0.000 


0.000 


0.000 


0.000 


0.000 


0.001 


0.003 


0.005 


0.011 


0.020 


25 


0.000 


0.000 


0.000 


0.000 


0.000 


0.001 


0.001 


0.003 


0.006 


0.012 


26 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.001 


0.002 


0.004 


0.008 


27 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.001 


0.002 


0.005 


28 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.001 


0.001 


0.003 


29 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.001 


0.002 


30 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.001 
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X 


15 


16 


17 


18 


19 


20 


21 


22 


23 


24 


16 


0.467 


0.566 


0.659 


0.742 


0.812 


0.868 


0.911 


0.942 


0.963 


0.978 


17 


0.371 


0.468 


0.564 


0.655 


0.736 


0.805 


0.862 


0.905 


0.937 


0.959 


18 


0.287 


0.375 


0.469 


0.562 


0.651 


0.731 


0.799 


0.855 


0.899 


0.932 


19 


0.215 


0.292 


0.378 


0.469 


0.561 


0.647 


0.726 


0.793 


0.849 


0.893 


20 


0.157 


0.221 


0.297 


0.381 


0.470 


0.559 


0.644 


0.721 


0.787 


0.843 


21 


0.111 


0.163 


0.227 


0.302 


0.384 


0.471 


0.558 


0.640 


0.716 


0.782 


22 


0.077 


0.117 


0.169 


0.233 


0.306 


0.387 


0.472 


0.556 


0.637 


0.712 


23 


0.052 


0.082 


0.123 


0.175 


0.238 


0.310 


0.389 


0.472 


0.555 


0.635 


24 


0.034 


0.056 


0.087 


0.128 


0.180 


0.243 


0.314 


0.392 


0.473 


0.554 


25 


0.022 


0.038 


0.060 


0.092 


0.134 


0.185 


0.247 


0.318 


0.394 


0.473 


26 


0.014 


0.025 


0.041 


0.065 


0.097 


0.139 


0.191 


0.252 


0.321 


0.396 


27 


0.009 


0.016 


0.027 


0.044 


0.069 


0.102 


0.144 


0.195 


0.256 


0.324 


28 


0.005 


0.010 


0.018 


0.030 


0.048 


0.073 


0.106 


0.148 


0.200 


0.260 


29 


0.003 


0.006 


0.011 


0.020 


0.033 


0.051 


0.077 


0.110 


0.153 


0.204 


30 


0.002 


0.004 


0.007 


0.013 


0.022 


0.035 


0.054 


0.081 


0.115 


0.157 



A 


X 


25 


26 


27 


28 


29 


30 


31 


32 


33 


34 


16 


0.987 


0.993 


0.996 


0.998 


0.999 


0.999 


1.000 








17 


0.975 


0.985 


0.991 


0.995 


0.997 


0.999 


0.999 


1.000 






18 


0.955 


0.972 


0.983 


0.990 


0.994 


0.997 


0.998 


0.999 


1.000 




19 


0.927 


0.951 


0.969 


0.981 


0.988 


0.993 


0.996 


0.998 


0.999 


0.999 


20 


0.888 


0.922 


0.948 


0.966 


0.978 


0.987 


0.992 


0.995 


0.997 


0.999 


21 


0.838 


0.883 


0.917 


0.944 


0.963 


0.976 


0.985 


0.991 


0.995 


0.997 


22 


0.777 


0.832 


0.877 


0.913 


0.940 


0.960 


0.974 


0.983 


0.990 


0.994 


23 


0.708 


0.772 


0.827 


0.873 


0.908 


0.936 


0.956 


0.971 


0.981 


0.988 


24 


0.632 


0.704 


0.768 


0.823 


0.868 


0.904 


0.932 


0.953 


0.969 


0.979 
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7.14.8 CRITICAL VALUES, KOLMOGOROV-SMIRNOV TEST 



One-sided test 


p = 0.90 


0.95 


0.975 


0.99 


0.995 


Two-sided test 


p = 0.80 


0.90 


0.95 


0.98 


0.99 


n = 1 


0.900 


0.950 


0.975 


0.990 


0.995 


2 


0.684 


0.776 


0.842 


0.900 


0.929 


3 


0.565 


0.636 


0.708 


0.785 


0.829 


4 


0.493 


0.565 


0.624 


0.689 


0.734 


5 


0.447 


0.509 


0.563 


0.627 


0.669 


6 


0.410 


0.468 


0.519 


0.577 


0.617 


7 


0.381 


0.436 


0.483 


0.538 


0.576 


8 


0.358 


0.410 


0.454 


0.507 


0.542 


9 


0.339 


0.387 


0.430 


0.480 


0.513 


10 


0.323 


0.369 


0.409 


0.457 


0.489 


11 


0.308 


0.352 


0.391 


0.437 


0.468 


12 


0.296 


0.338 


0.375 


0.419 


0.449 


13 


0.285 


0.325 


0.361 


0.404 


0.432 


14 


0.275 


0.314 


0.349 


0.390 


0.418 


15 


0.266 


0.304 


0.338 


0.377 


0.404 


20 


0.232 


0.265 


0.294 


0.329 


0.352 


25 


0.208 


0.238 


0.264 


0.295 


0.317 


30 


0.190 


0.218 


0.242 


0.270 


0.290 


35 


0.177 


0.202 


0.224 


0.251 


0.269 


40 


0.165 


0.189 


0.210 


0.235 


0.252 


Approximation 


1.07 


1.22 


1.36 


1.52 


1.63 


forn > 40: 


\fn 


\fn 


\fn 


\fn 


\fn 



7.14.9 CRITICAL VALUES, TWO SAMPLE 
KOLMOGOROV-SMIRNOV TEST 

The value of D listed below is so large that the hypothesis Ho, the two distributions 
are the same, is to be rejected at the indicated level of signi cance. Here, n \ and ri2 
are assumed to be large, and D = max \F ni (x) — F n2 (x) \ . 



Level of signi cance 


Value of D 


a = 0.10 


1.22t/ ni+ " 2 


V ™1™2 


a = 0.05 


1.36, /™ 1+ ™ 2 


V ™1™2 


a = 0.025 


1.48, /" 1+ " 2 




V ™1™2 


a = 0.01 


1.63, / ni +" 2 


V ™1™2 


a = 0.005 


1.73, /™ 1+ ™ 2 


V ™1™2 


a = 0.001 


1.95, /™ 1+ ™ 2 


V ™1™2 
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7.14.10 CRITICAL VALUES, SPEARMAN'S RANK 
CORRELATION 



Spearman's coef cien t of rank correlation, p s , measures the correspondence between 
two rankings. Let di be the difference between the ranks of the i th pair of a set of n 
pairs of elements. Then Spearman's rho is de ned as 

n _ , _ 6EHi^ _ i _ 6 S r 
n A — n n A — n 

where S r = d 2 . The table below gives critical values for S r when there is 

complete independence. 



n 


p = 0.90 


p = 0.95 


p = 0.99 


p = 0.999 


4 


0.8000 


0.8000 






5 


0.7000 


0.8000 


0.9000 




6 


0.6000 


0.7714 


0.8857 




7 


0.5357 


0.6786 


0.8571 


0.9643 


8 


0.5000 


0.6190 


0.8095 


0.9286 


9 


0.4667 


0.5833 


0.7667 


0.9000 


10 


0.4424 


0.5515 


0.7333 


0.8667 


11 


0.4182 


0.5273 


0.7000 


0.8364 


12 


0.3986 


0.4965 


0.6713 


0.8182 


13 


0.3791 


0.4780 


0.6429 


0.7912 


14 


0.3626 


0.4593 


0.6220 


0.7670 


15 


0.3500 


0.4429 


0.6000 


0.7464 


20 


0.2977 


0.3789 


0.5203 


0.6586 


25 


0.2646 


0.3362 


0.4654 


0.5962 


30 


0.2400 


0.3059 


0.4251 


0.5479 



7.15 SIGNAL PROCESSING 



7.15.1 ESTIMATION 

Let {et} be a white noise process (so that E[et] = /i, Var[ej] = a 2 , and Cov [ej, e s ] = 
for s ^ i). Suppose that {X t } is a time series. A non-anticipating linear model 
presumes that ^^Lo h u Xt- u = et, where the {h u } are constants. This can be writ- 
ten H(z)X t = e t where H(z) = Y^=o^uZ u and z n X t = X t _ n . Alternately, 
X t = H~ l (z)e t . In practice, several types of models are used: 

1. AR(fc), autoregressive model of order k: This assumes that 
H(z) = 1 + a\z + ■ ■ ■ + (ikZk and so 

X t +a 1 X t _ 1 + ...a k X t _ k = e t . (7.15.1) 
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2. MA(i), moving average of order I: This assumes that 
H~ L (z) = 1 + b\z + ■ ■ ■ + b k z k and so 

X t = e t + b 1 e t -i+ ...bie t -i. (7.15.2) 

3. ARMA(fc,Z), mixed autoregressive/moving average of order (k,l): This as- 
sumes that H- 1 (z) = ^±hi2±^±hm an d so 

v ' l+aiz-i \-a k z k 

X t + aiX t _i + . . . a k X t _ k = e t + he t -i H h 6je t _;. (7.15.3) 



7.15.2 KALMAN FILTERS 

Kalman ltering is a linear least-squares recursive estimator. It is used when the 
state space has a higher dimension than the observation space. For example, in some 
airport radars the distance to aircraft is measured and the velocity of each aircraft is 
inferred. 

1 . x is the unknown state to be estimated 

2. x is the estimate of x 

3. z is an observation 

4. {w, v} are noise terms 

5. {Q, R} are spectral density matrices 

6. "a ~ N(b, C)" means that the random variable a has a normal distribution 
with a mean of b and a covariance matrix of C. 

7. "Extended Kalman Iter": State propagation is achieved through sequential 
linearizations of the system model and the measurement model. 

8. "(— )" is the value before a new discrete observation and "(+)" is the value 
after a new discrete observation 



7.15.2.1 Discrete Kalman Iter 



System model x k = ^-iX/^i +w k - 1 ; w k ~ N(0,Q k ) 

Measurement model z k = H k x k +v k ; v k ~ N(0,R k ) 

Initial conditions E [x(0)] = x , E [(x(0) - x o )(x(0) - x ) T ] = P 

Other assumptions E [w^vj] = for all j and k 

State estimate extrapolation x^(— ) = $^_ix^_i(+) 

Error covariance extrapolation P k (-) = $ k -iP k -i(+)^_ L + Q k -\ 

State estimate update *k(+) = *k(— ) + K k [z k — H k x k (—)] 

Error covariance update Pk(+) = [I — K k H k ] P k {—) 

Kalman gain matrix K k = P k (-)Hj [H k P k (-)Hj + R k ]~ L 



© 2003 by CRC Press LLC 



7.15.2.2 Continuous Kalman Iter 



System model x(t) = F(t)x(t) + G(t)v/(t); w(t) ~ N(0, Q(t)) 

Measurement model z(t) = H(t)x(t) + \(t); \(t) ~ N(0, R(t)) 

Initial conditions x(0) = x , P(0) = Pq, 

E[x(0)] = Xq, E [(x(0) -x o )(x(0) -x ) T ] = P 
Other assumptions exists, E [w(»v t (t)] = C(t)8(t - r) 

State estimate propagation x(t) = F(t)x(t) + K(t) [z(t) - H(t)x(t)} 

Error covariance P(t) = F(t)P(t) + P(t)F T (t) 

propagation +G(t)Q (t)G T (t) - K(t)R(t) K T (t) 

Kalman gain matrix K{t) = [P(t)H T (t) + G{t)C{t)} iT 1 (t) 



7.15.2.3 Continuous extended Kalman Iter 



System model 


x(t)=f(x(t),t)+w(t); 


w(t) ~iV(0,Q(t)) 


Measurement model 


z(t) =h(x(t))+v(t); 


v(i) ~ N(0,R(t)) 


Initial conditions 
Other assumptions 


x(0) ~iV(xo,P ) 

E [w(i)v T (r)] = for all t and all r 


State estimate propagation 
Error covariance propagation 


x(t) = f(x(t),t) + K{t) [z(t) - h(x(t),t)} 
P{t) = F(x(t),t)P(t) + P(t)F T (x(t),t)+Q(t) 
-P(t)H T (x(t),t)R- 1 (t)H(x(t),t)P(t) 


Gain equation 


K{t) = P(t)H T (x(t),t)R- 1 (t) 


De nition s 


FR(t) n _ ««*)>*) 
F(XW '* } - dx(t) 


x(t)=i(t) 
x(t)=i(t) 
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7.15.2.4 Continuous-discrete extended Kalman Iter 



System model x(t) = f(x(t),t) + w(i); w(i) ~ N(0, Q(t)) 

Measurement model z k = h k (x(t k )) + v^; ~ N(0,R k ) 

fc = l,2,... 

Initial conditions x(0) ~ N(xq, P ) 

Other assumptions E [w(£)v£] = for all k and all t 

State estimate propagation x(i) = f (x(t) , i) 

Error covariance propagation = F(x(t),t)P(t) + P(t)F T (x(t),t) + Q(t) 

State estimate update x^ (+) = (— ) + if* [z* — (x* (— ))] 

Error covariance update Pk(+) = [I - K k H k (x k (-))] P k (-) 

Gain matrix K k = P k (-)Hj (%(-)) 

x [H k (x k (-))P k (-)Hl(x k (-)) + Ilk]' 1 



~ ■■ , , df(x(t),t) 

Demtions F(x(t),t) - 



dx(t) 

H k (x k (-)) ~ dhk{X{h)) 



dx(t k ) 



*(*)=*(*) 
x(t* )=**(- 



7.15.3 MATCHED FILTERING (WIENER FILTER) 

Let represent a signal to be recovered, let N(t) represent noise, and let Y (t) = 
X(t) + N(t) represent the observable signal. A prediction of the signal is 

/>oo 

X p (t)= K(z)Y(t - z)dz, (7.15.4) 



where K(z) is a Iter . The mean square error is E — X p (t)) 2 ] ; this is mini- 

mized by the optimal (Wiener) Iter K opt (z). 

When X and Y are stationary, de ne their autocorrelation functions as R xx (t — 
s) = E[X(t)X(s)] and R YY (t - s) = E[Y(t)Y(s)]. If T represents the Fourier 
transform (see page 576), then the optimal Iter is given by 

For example, if X and N are uncorrected, then 

T[K °^ )] = h?[R X xml X r& NN {t)y (7 ' 15 - 6) 

In the case of no noise, T \K ovX _{f)\ = K opt (t) = S(t), and S p (t) = Y(t). 
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7.15.4 WALSH FUNCTIONS 

The Rademacher functions are de ned by ru{x) = sgnsin (2 k+1 Trx) . If the binary 
expansion of n has the form n = 2 H + 2 t2 + ■ ■ ■ + 2 %m , then the Walsh function of 
order n is W n (x) = {x)r^ (x) . . . Ti m (x). 



1 | W 9 




Wo 
Wi 

w 2 
w 3 

w 5 
w 6 
w 7 



1 | w 10 



Wu 



Wr 



W 13 



Wi 



W 15 



"1 1 1 1 1 1 1 1 

0.5 1 
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7.15.5 WAVELETS 



The Haar wavelet is H(x) = 1 if < x < 1/2, —1 if 1/2 < x < 1, and otherwise. 
Dene H jtk (x) = 2 j / 2 H(2 j x-k). Then the Haar system, {i? iji; }+^_ 00 , forms an 
orthonormal basis for the Hilbert space, I/ 2 (ffi), consisting of functions / with nite 
energy, i.e., \f(x)\ 2 dx < oo. 

7.15.5.1 De nitions 

The construction of other wavelet orthonormal bases {ip j,k}^k^-oo begins by choos- 
ing real coef cien ts ho, . . . , h n which satisfy the following conditions (we set hu = 
if k < or k > n): 

1. Normalization: ^2 k hk = V%- 

2. Orthogonality: J2 k hu hu-ij = 1 if j = and if j ^ 0. 

3. Accuracy p: l^ k {—^-) k k^hk = for j = 0, . . . ,p — 1 withp > 0. 

4. Cohen-Lawton criterion: A technical condition only rarely violated by coef- 
cients which satisfy the normalization, orthogonality, and accuracy p condi- 
tions. 

The terms order of approximation or Strang-Fix conditions are often used in place 
of "accuracy". The orthogonality condition implies that n is odd. 

The four conditions above imply the existence of a solution tp € L 2 (M), called 
the scaling function, to the following re nem ent equation: 

n 

<p(x) = V2j2 h k<fi(2x-k). (7.15.7) 

The scaling function has a non-vanishing integral which we normalize: J <p(x) dx = 
1. Then <p(x) is unique, and it vanishes outside of the interval [0, n]. The maximum 
possible accuracy is p = (n+l)/2. Thus, increasing the accuracy requires increasing 
the number of coef c ients hu- High accuracy is desirable, as it implies that each of 
the polynomials 1, x, . . . , x p ~ 1 can be written as an in nite linear combination of the 
integer translates ip(x — k). In particular, J2 k ip(x — k) = 1. Also, the smoothness 
of (p is limited by the accuracy; tp can have at most n — 2 derivatives, although in 
practice it usually has fewer. 

For each x ed integer j, let Vj be the closed subspace of L 2 (E) spanned by 
the functions, {tfij,k} k^°-oo> wn ere pj^{x) = 2^ 2 ip{2^x — k). The sequence of 
subspaces {Vjjtf*^ forms a multi-resolution analysis for L 2 (K), meaning that: 

1. The subspaces are nested: • • • C V_i C Vq C V\ ■ ■ ■ . 

2. They are obtained from each other by dilation by 2: v(x) € Vj v(2x) € 
Vj+i- 

3. Vo is integer translation invariant: v(x) G Vq <=^> v(x + 1) G Vq. 

4. The Vj increase to all of L 2 (E) and decrease to zero: UVj is dense in L 2 (E) 
and HVj = {0}. 

5. The set of integer translates {tp(x — k)}^^^ forms an orthonormal basis 
fori,,. 
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The projection of f(x) onto the subspace Vj is an approximation at resolution 
level 2~f It is given by fj(x) = J2k c i,k <Pi,k{x) with 

c j,k = if,<Pj,k) = J fix) <Pj,k(x) dx. (7.15.8) 
The wavelet ip is derived from the scaling function <p by the formula, 

n 

4> (x) = V2j29kf(2x-k), where g k = {-if h n - k . (7.15.9) 

The wavelet ip has the same smoothness as <p, and the accuracy p condition implies 
vanishing moments for ip: J x^ip{x) dx = for j = 0, . . . ,p — 1. The functions 
ipj,k(x) = 2 J '/ 2 ^>(2 J 'x — k) are orthonormal, and the entire collection {ip j, k }1p k *f_ 00 
forms an orthonormal basis for L 2 (E). 

With j x ed, let Wj be the closed subspace of L 2 (E) spanned by ip(2^x — k) 
for integer k. Then Vj and Wj are orthogonal subspaces whose direct sum is Vj+i . 
Let / be a function and let pj = J2k dj,k <Pj,k(x) be its projection onto Wj, where 
dj,k = if,ipj,k)- Then the approximation with resolution 2~( J+1 ) is /j+i = 
/j + pj, the sum of the approximation /j at resolution 2 _J and the additional ne 
details pj needed to give the next higher resolution level. 

The discrete wavelet transform is an algorithm for computing the coef cien ts 
Cj t k and dj t k from the coef cients Cj+i^. It can also be interpreted as an algorithm 
dealing directly with discrete data, dividing data Cj+i^ into a low-pass part Cj t u and 
a high-pass part dj^. Speci cally , 

Cj,i = Cj+i,*, and djj = ^ g k - 2 i c j+1 , k . (7.15.10) 

The inverse transform is 

c i+i,fc = ^ ^*-2/ c j,f + '^gk-2i djj. (7.15.11) 

The discrete wavelet transform is closely related to engineering techniques known as 
sub-band coding and quadrature mirror Itering . 

EXAMPLE The Daubechies family. For each even integer N > 0, there is a unique 
set of coef cients ho, . . . , Hn-i which satisfy the normalization and orthogonality 
conditions with maximal accuracy p = N/2. The corresponding ip and ip are the 
Daubechies scaling function Dn and Daubechies wavelet Wn ■ The Haar wavelet 
H is the same as the Daubechies wavelet Wi . For the Haar wavelet, the coef - 
cients are ho = hi = 1/ %/2 and the subspace Vj consists of all functions which are 
piecewise constant on each interval [k2~ 3 , (k + 1)2 -J ). The coef cients for D4 are: 
h = (1 + v / 3)/(4 V / 2), hi = (3 + y/3)/(4y/2), h 2 = (3 - y/3)/(4s/2), and h 3 = 
(1 - v/3)/(4^2). 

7.15.5.2 Generalizations 

For a given number of coef cien ts, the Daubechies wavelet has the highest accuracy. 
Other wavelets reduce the accuracy in exchange for other properties. In the Coi et 
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family the scaling function and the wavelet possesses vanishing moments, leading to 
simple one-point quadrature formulae. The "least asymmetric" wavelets are close to 
being symmetric or antisymmetric (perfect symmetry is incompatible with orthogo- 
nality, except for the Haar wavelet). 

Wavelet packets are libraries of basis functions de ned recursively from the scal- 
ing functions <j> and ip. The Walsh functions are wavelet packets based on the Haar 
wavelet. 

Allowing in nitely many coef cien ts results in wavelets supported on the entire 
real line. The Meyer wavelet is band-limited, possesses in nitely many derivatives, 
and has accuracy p = oo. The Battle-Lemarie wavelets are piecewise splines and 
have exponential decay. 

M-band wavelets replace the ubiquitous dilation factor 2 by another integer M. 
Multiwavelets replace the coef cien ts hu by r x r matrices and the scaling function 
and wavelet by vector- valued functions (<pi, . . . ,<p r ) and (ipi, . . . , ip r ), resulting in 
an orthonormal basis for L 2 (E) generated by the several wavelets ipi , . . . , ip r . 

For higher dimensions, a separable wavelet basis is constructed via a tensor 
product, with scaling function ip(x)ip(y) and three wavelets ip(x)tp(y), ip(x)<p(y), 
ip(x)ip(y). Non-separable wavelets replace the dilation factor 2 by a dilation matrix. 

Biorthogonal wavelets allow greater e xibility of design by relaxing the require- 
ment that the wavelet system {tjjj,k} form an orthonormal basis to requiring only 
that it form a Riesz basis. The Cohen-Daubechies-Feauveau wavelets are symmet- 
ric and their coef cien ts hu are dyadic rationals. The Chui-Wang-Aldroubi-Unser 
semiorthogonal wavelets are splines with explicit analytic formulae. 

The basis condition may be further relaxed by allowing {tjj j,k} to be a frame, an 
over-complete system with basis-like properties. Introducing further redundancy, the 
continuous wavelet transform uses all possible dilates and translates a 1/,2 ^(ax + b). 



7.15.5.3 Wavelet coef cients and gures 

Coef cients for Daubechies scaling functions 1 



D 2 : ho: 0.707106781187 

hi: 0.707106781187 

D 4 : h : 0.482962913145 

hi. 0.836516303738 

h 2 : 0.224143868042 

h 3 : -0.129409522551 



Da 



h 
hi 
h 2 
h 3 
hi 
h 5 



0.332670552950 
0.806891509311 
0.459877502118 
-0.135011020010 
-0.085441273882 
0.035226291886 



'The tables and gures shown below are reprinted with permission from Daubechies, I., Ten Lectures 
on Wavelets. Copyright ©1992 by the Society for Industrial and Applied Mathematics, Philadelphia, PA. 
All rights reserved. 
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o 


230377813309 


Di o ' hn 


0.111540743350 




o 


714846570553 


/ 1,1 


494623890398 


h-> 


o 


630880767930 


h-> 


751133908021 


hi 


-0 


027983769417 


hi 


315250351709 


1 0/[ 


— n 

u 




1 0/[ 




h- 


n 

U 


030841 381 836 




—0 1 2Q766867567 


ha 


n 

U 


03288301 1 667 


he 


0.097501605587 


h„ 
< l 7 


— n 




h 7 


0.027522865530 








h s 


-0.031582039317 


hr> 


o 


160102397974 


hg 


0.000553842201 


hi 


o 


603829269797 


h w : 0.004777257511 


ho 


o 


724308528438 


hn: -0.001077301085 


hi 


o 


138428145901 






hi 


-0 


242294887066 






h* 


-0 


032244869585 






h 6 





077571493840 






h 7 


-0 


006241490213 






h s 


-0 


012580751999 






hg 





003335725285 
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Chapter 




Special Functions 



6. 1 TRIGONOMETRIC OR CIRCULAR FUNCTIONS 

6.1.1 Definition of angles 

6.1.2 Characterization of angles 

6.1.3 Circular functions 

6.1.4 Circular functions of special angles 

6.1.5 Evaluating sines and cosines at multiples of n 

6.1.6 Symmetry and periodicity relationships 

6.1.7 Functions in terms of angles in the first quadrant 

6.1.8 One circular function in terms of another 

6.1.9 Circular functions in terms of exponentials 

6.1.10 Fundamental identities 

6.1.11 Angle sum and difference relationships 

6.1.12 Double-angle formulae 

6.1.13 Multiple-angle formulae 

6.1.14 Half-angle formulae 

6.1.15 Powers of circular functions 

6.1.16 Products of sine and cosine 

6.1.17 Sums of circular functions 

6.2 CIRCULAR FUNCTIONS AND PLANAR TRIANGLES 

6.2.1 Right triangles 

6.2.2 General plane triangles 

6.2.3 Half-angle formulae 

6.2.4 Solution of triangles 

6.2.5 Tables of trigonometric functions 

6.3 INVERSE CIRCULAR FUNCTIONS 

6.3.1 Definition in terms of an in tegral 

6.3.2 Principal values of the inverse circular functions 

6.3.3 Fundamental identities 

6.3.4 Functions of negative arguments 

6.3.5 Relationship to inverse hyperbolic functions 

6.3.6 Sum and difference of two inverse circular functions 

6.4 CEILING AND FLOOR FUNCTIONS 

6.5 EXPONENTIAL FUNCTION 

6.5.1 Exponentiation 

6.5.2 Definition of e z 

6.5.3 Derivative and integral of e x 
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6.6 LOGARITHMIC FUNCTIONS 

6.6.1 Definition of the natural logarithm 

6.6.2 Logarithm of special values 

6.6.3 Relating the logarithm to the exponential 

6.6.4 Identities 

6.6.5 Series expansions for the natural logarithm 

6.6.6 Derivative and integration formulae 

6.7 HYPERBOLIC FUNCTIONS 

6.7.1 Definitions of the hyperbolic functions 

6.7.2 Range of values 

6.7.3 Hyperbolic functions in terms of one another 

6.7.4 Relations among hyperbolic functions 

6.7.5 Relationship to circular functions 

6.7.6 Series expansions 

6.7.7 Symmetry relationships 

6.7.8 Sum and difference formulae 

6.7.9 Multiple argument relations 

6.7.10 Sums of functions 

6.7.11 Products of functions 

6.7.12 Half-argument formulae 

6.7.13 Differentiation formulae 

6.8 INVERSE HYPERBOLIC FUNCTIONS 

6.8.1 Range of values 

6.8.2 Relationships among inverse hyperbolic functions 

6.8.3 Relationships with logarithmic functions 

6.8.4 Relationships with circular functions 

6.8.5 Sum and difference of functions 

6.9 GUDERMANNIAN FUNCTION 

6.9.1 Fundamental identities 

6.9.2 Derivatives of Gudermannian 

6.9.3 Relationship to hyperbolic and circular functions 

6.9.4 Numerical values of hyperbolic functions 

6.10 ORTHOGONAL POLYNOMIALS 

6.10.1 Hermite polynomials 

6.10.2 Jacobi polynomials 

6.10.3 Laguerre polynomials 

6.10.4 Generalized Laguerre polynomials 

6.10.5 Legendre polynomials 

6.10.6 Chebyshev polynomials, first kind 

6.10.7 Chebyshev polynomials, second kind 

6.10.8 Tables of orthogonal polynomials 

6.10.9 Zernike polynomials 

6.10.10 Spherical harmonics 

6.11 GAMMA FUNCTION 

6.11.1 Recursion formula 

6.11.2 Gamma function of special values 

6.11.3 Properties 

6.11.4 Asymptotic expansion 

6.11.5 Logarithmic derivative of the gamma function 
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6.11.6 Numerical values 

6.12 BETA FUNCTION 

6.12.1 Numerical values of the beta function 

6. 13 ERROR FUNCTIONS 

6.13.1 Properties 

6.13.2 Error function of special values 

6.13.3 Expansions 

6.13.4 Special cases 

6.14 FRESNEL INTEGRALS 

6.14.1 Properties 

6.14.2 Asymptotic expansion 

6.14.3 Numerical values of error functions and Fresnel integrals 

6. 15 SINE, COSINE, AND EXPONENTIAL INTEGRALS 

6.15.1 Sine and cosine integrals 

6.15.2 Exponential integrals 

6.15.3 Logarithmic integral 

6.15.4 Numerical values 

6.16 POLYLOGARITHMS 

6.16.1 Polylogarithms of special values 

6.16.2 Polylogarithm properties 

6. 1 7 HYPERGEOMETRIC FUNCTIONS 

6.17.1 Special cases 

6.17.2 Properties 

6.17.3 Recursion formulae 

6.18 LEGENDRE FUNCTIONS 

6.18.1 Differential equation: Legendre function 

6.18.2 Definition 

6.18.3 Singular points 

6.18.4 Relationships 

6.18.5 Recursion relationships 

6.18.6 Integrals 

6.18.7 Polynomial case 

6.18.8 Differential equation: associated Legendre function 

6.18.9 Relationships between the associated and ordinary Legendre functions 

6.18.10 Orthogonality relationship 

6.18.11 Recursion relationships 

6.19 BESSEL FUNCTIONS 

6.19.1 Differential equation 

6.19.2 Singular points 

6.19.3 Relationships 

6.19.4 Series expansions 

6.19.5 Recurrence relationships 

6.19.6 Behavior as z — > 

6.19.7 Integrals 

6.19.8 Fourier expansion 
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6.19.9 Auxilia ry functions 

6.19.10 Inverse relationships 

6.19.11 Asymptotic expansions 

6.19.12 Zeros of Bessel functions 

6.19.13 Half order Bessel functions 

6.19.14 Modified Bessel functions 

6.19.15 Airy functions 

6.19.16 Numerical values for the Bessel functions 

6.20 ELLIPTIC INTEGRALS 

6.20.1 Definitions 

6.20.2 Properties 

6.20.3 Numerical values of the elliptic integrals 

6.21 JACOBIAN ELLIPTIC FUNCTIONS 

6.21.1 Properties 

6.21.2 Derivatives and integrals 

6.21.3 Series expansions 

6.22 CLEBSCH-GORDAN COEFFICIENTS 

6.23 INTEGRAL TRANSFORMS: PRELIMINARIES 

6.24 FOURIER TRANSFORM 

6.24.1 Existence 

6.24.2 Properties 

6.24.3 Inversion formula 

6.24.4 Poisson summation formula 

6.24.5 Shannon 's sampling theorem 

6.24.6 Uncertainty principle 

6.24. 7 Fourier sine and cosine transforms 

6.25 DISCRETE FOURIER TRANSFORM (DFT) 

6.25.1 Properties 

6.26 FAST FOURIER TRANSFORM (FFT) 

6.27 MULTIDIMENSIONAL FOURIER TRANSFORM 

6.28 LAPLACE TRANSFORM 

6.28.1 Existence and domain of convergence 

6.28.2 Properties 

6.28.3 Inversion formulae 

6.28.4 Convolution 

6.29 HANKEL TRANSFORM 

6.29.1 Properties 

6.30 HARTLEY TRANSFORM 

6.31 HILBERT TRANSFORM 
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6.31.1 Existence 

6.31.2 Properties 

6.31.3 Relationship with the Fourier transform 



6.32 Z -TRANSFORM 

6.32.1 Examples 

6.32.2 Properties 

6.32.3 Inversion formula 

6.32.4 Convolution and product 

6.33 TABLES OF TRANSFORMS 



6.1 TRIGONOMETRIC OR CIRCULAR FUNCTIONS 



6.1 .1 DEFINITION OF ANGLES 

If two lines intersect and one line is rotated about the point of intersection, the angle 
of rotation is designated positive if the rotation is counterclockwise. Angles are 
commonly measured in units of radians or degrees. Degrees are a historical unit 
related to the calendar defined by a complete revolution equalling 360 degrees (the 
approximate number of days in a year), written 360°. Radians are the angular unit 
usually used for mathematics and science. The radian measure of an angle is defined 
as the arc length traced by the tip of a rotating line divided by the length of that 
line. Thus a complete rotation of a line about the origin corresponds to 2tt radians of 
rotation. It is a convenient convention that a full rotation of 2ir radians is divided into 
four angular segments ofn/2 each and that these are referred to as the four quadrants 
designated by Roman numerals I, II, III, and IV (see Figure 6.1). 



6.1 .2 CHARACTERIZATION OF ANGLES 

A right angle is the angle between two perpendicular lines. It is equal ton/2 radians 
or 90 degrees. An acute angle is a positive angle less than 7r/2 radians. An obtuse 
angle is one between 7r/2 and 7r radians. A convex angle is one between and 7r 
radians. 
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FIGURE 6.1 

The four quadrants (left) and notation for trigonometric functions (right). 





6.1.2.1 Relation between radians and degrees 

The angle n radians corresponds to 180 degrees. Therefore, 

180 

one radian = degrees = 57.30 degrees, 

I ' (6-1.1) 

one degree = radians = 0.01745 radians. 



6.1.3 CIRCULAR FUNCTIONS 

Consider the rectangular coordinate system shown in Figure 6.1. The coordinate x 
is positive to the right of the origin and the coordinate y is positive above the origin. 
The radius vector r shown terminating on the point P(x, y) is shown rotated by the 
angle a up from the x axis. The radius vector r has component values x and y. 
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The trigonometric or circular functions of the angle a are defined in terms of 
the signed coordinates x and y and the length r, which is always positive. Note that 
the coordinate x is negative in quadrants II and III and the coordinate y is negative 
in quadrants III and IV. The definitions of the trigonometric functions in terms of the 
Cartesian coordinates x and y of the point P(x,y) are shown below. In formulae, 
the angle a is usually specified in radian measure. 

sine a = sin a = y/r, cosine a = cos a = x/r, 

tangent a = tana = y/x, cotangent a = cot a = x/y, (6.1.2) 

cosecanta = csca = r/y, secanta = seca = r/x. 

There are also the following seldom used functions: 

versed sine of a = versine of a = vers a = 1 — cos a, 
coversed sine of a = versed cosine of a = covers a = 1 — sin a, 
exsecant of a = exsec a = sec a — 1, 
haversine of a = hava = \ versa = \{1 — cos a). 



6.1 .3.1 Signs in the four quadrants 



Quadrant 


sin 


cos 


tan 


CSC 


sec 


cot 


I 


+ 


+ 


+ 


+ 


+ 


+ 


II 


+ 






+ 






III 






+ 






+ 


IV 




+ 






+ 
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FIGURE 6.4 

Tangent and cotangent; angles are in radians. 




6.1 .4 CIRCULAR FUNCTIONS OF SPECIAL ANGLES 



Angle 


= 0° 


tt/12 = 15° 


it/6 = 30° 


tt/4 = 45° 


tt/3 = 60° 


sin 





f (V3-1) 


1/2 


y/2/2 


v^/2 


cos 


1 




V3/2 


V2/2 


1/2 


tan 





2-i/3 




1 


V3 


CSC 


00 


V2(V3 + 1) 


2 




2i/3/3 


sec 


1 


V2(V3-1) 


2i/3/3 


V2 


2 


cot 


00 


2 + V3 


V3 


1 


>/3/3 



Angle 


5tt/12 = 75° 


tt/2 = 90° 


7tt/12 = 105° 


2tt/3 = 120° 


sin 


^(>/3 + l) 


1 


^(V3 + l) 


V3/2 


cos 


f (V3-1) 







-1/2 


tan 


2 + i/3 


00 


-(2 + y/S) 


-VI 


CSC 


V2(V3-1) 


1 


V2(V3-1) 


2i/3/3 


sec 


V2(V3 + 1) 


00 


-V2(V3 + 1) 


-2 


cot 


2-i/3 





-(2 - V3) 


-V3/3 



Angle 


3tt/4 = 135° 


5tt/6 = 150° 


Htt/12 = 165° 


7T = 180° 


sin 


V2/2 


1/2 







cos 


-y/2/2 


-V3/2 


-^(V3 + l) 


-1 


tan 


-1 


-V3/3 


-(2->/3) 





CSC 


V2 


2 


V^(>/3 + l) 


00 


sec 


-V2 


-2V3/3 


->/2(>/3-l) 


-1 


cot 


-1 


-y/3 


-(2 + >/3) 


00 
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6.1 .5 EVALUATING SINES AND COSINES AT MULTIPLES OF w 

The following table is useful for evaluating sines and cosines in multiples of tt: 





n an integer 


n even 


n odd 


n/2 odd 


n/2 even 


sin nir 

















cos nir 


(-1)" 


+1 


-1 


+1 


+ 1 


sin mr/2 







(_l)(«-l)/2 








cos mr/2 




(_l)«/2 





-1 


+ 1 





n odd n/2 odd n/2 even 


sin ri7r/4 


(_l)(n 2 +4n+H)/8/ 1k /2 (-1)(™- 2 )/ 4 



Note the useful formulae (where i 2 = — 1) 

gin mr = [( _ 1)n _ 1L mr = £ [( _ 1)n + ^ ^ 

6.1 .6 SYMMETRY AND PERIODICITY RELATIONSHIPS 

sin (—a) = — sin a, cos (—a) = + cos a, tan (—a) = — tana. (6.1.4) 
When n is any integer, 

sin (a + n2ir) = sin a, 

cos (a + n27r) = cosa, (6.1.5) 
tan (a + n7r) = tan a. 

6.1 .7 FUNCTIONS IN TERMS OF ANGLES IN THE FIRST 
QUADRANT 

When n is any integer: 





—a 


-±a 


?r±a 


3tt 

T ±a 


2mr±a 


sin 


— sin a 


cos a 


=F sin a 


— cosa 


± sin a 


cos 


cosa 


^sina 


— cosa 


± sin a 


+ cosa 


tan 


— tan a 


=F cot a 


± tan a 


=F cot a 


± tan a 


CSC 


— esc a 


sec a 


=F esc a 


— sec a 


± esc a 


sec 


sec a 


=F esc a 


— sec a 


± esc a 


sec a 


cot 


— cot a 


=Ftana 


± cot a 


^tana 


± cot a 
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6.1 .8 ONE CIRCULAR FUNCTION IN TERMS OF ANOTHER 

ForO < x < it/2, 





sin a; 


cos a; 


tana; 


sin a; = 

cos a; = 
tana; = 

CSC X = 

secx = 
cot x = 


sin a; 

/ 9 

V 1 — sin x 

sin a; 


\/\ — cos 2 X 
cos a; 


tana; 


Vl + tan 2 a; 
1 


Vl + tan 2 a; 
tana; 


\/l — cos 2 a; 


\/l — sin 2 x 
1 


cos a; 
1 


Vl + tan 2 a; 


sin a; 

1 


Vl — cos 2 X 

1 


tana; 
Vl + tan 2 a; 

1 


\/l — sin 2 x 


cos a; 
cos a; 


\/l — sin 2 x 


sin a; 


Vl — cos 2 X 


tana; 






esc a; 


secx 


cot a; 


sin a; = 

cos a; = 

tana; = 

esc a; = 

sec a; = 
cot a; = 


1 


V sec 2 x — 1 


1 


esc a; 


sec a; 

1 


Vl + cot 2 X 
cot a; 


Vcsc 2 x — 1 


esc a; 
1 


sec a; 

V sec 2 a; — 1 
sec a; 


Vl + cot 2 X 
1 


Vcsc 2 x — 1 
csc a; 
esc a; 


cot a; 

Vl + cot 2 X 
Vl + cot 2 X 


V sec 2 a; — 1 
sec a; 

1 


Vcsc 2 x — 1 
Vcsc 2 x — 1 


cot a; 
cot a; 


V sec 2 a; — 1 



6.1 .9 CIRCULAR FUNCTIONS IN TERMS OF EXPONENTIALS 



e lz +e~ lz iz 
cos z = e = cos z + ismz 

e iz - e~ iz _ iz 

sin z = e = cos z — ismz 

2i 

sin z e tz — e~ tz . 2 
tan z = = — where i = — 1 and z may be complex 

cos z i{e tz + e- tz ) 
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6.1.10 FUNDAMENTAL IDENTITIES 

1. Reciprocal relations 

1 1 sin a 

sin a = , cos a = , tan a 



esc a sec a cos a cot a 

1 1 cos a 1 



csca= — , seca = , cot a 



sina cos a sin a; tana 

2. Pythagorean theorem 

sin 2 z + cos 2 z = 1 
sec 2 z — tan 2 z = 1 
esc 2 z — cot 2 z = 1 

3. Product relations 

sin a = tan a cos a cos a = cot a sin a 

tan a = sin a sec a cot a = cos a esc a 

sec a = esc a tan a esc a = sec a cot a 

4. Quotient relations 

tana cot a sina 
sin a = cos a = tan a = 

sec a esc a cos a 

sec a esc a cos a 

esc a = sec a = cot a = — 

tan a cot a sin a 



6.1 .1 1 ANGLE SUM AND DIFFERENCE RELATIONSHIPS 

sin (a ± j8) = sin a cos /3 ± cos a sin /3 
cos (a ± j8) = cos a cos /? ^ sin a sin /3 
tan a ± tan /3 



tan (a ± /?) 
cot (a ± 0) 



1 =F tan a tan /3 
cot a cot =f 1 
cot j8 ± cot a 



6.1.12 DOUBLE-ANGLE FORMULAE 

. . 2 tan a 

sin 2a = 2 sin a cos a 



1 + tan 2 a 

cos 2a = 2 cos 2 a — 1 = 1 — 2 sin 2 a = cos 2 a — sin 2 a 



1 — tan 2 a 



tan 2a 
cot 2a 



1 + tan 2 a 
2 tan a 



1 — tan 2 a 
cot 2 a - 1 
2 cot a 
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6.1.13 MULTIPLE-ANGLE FORMULAE 

sin 3a = —4 sin 3 a + 3 sin a. 
sin 4a = —8 sin 3 a cos a + 4 sin a cos a. 
sin 5a = 16 sin 5 a — 20 sin 3 a + 5 sin a. 
sin 6a = 32 sin a cos 5 a — 32 sin a cos 3 a + 6 sin a cos a. 
sin na = 2 sin (n — l)a cos a — sin (n — 2)a. 
cos 3a = 4 cos 3 a — 3 cos a. 
cos 4a = 8 cos 4 a — 8 cos 2 a + 1. 
cos 5a = 16 cos 5 a — 20 cos 3 a + 5 cos a. 
cos 6a = 32 cos 6 a — 48 cos 4 a + 18 cos 2 a — 1. 
cos na = 2 cos (n — l)acosa — cos (n — 2)a. 
tan 3 a + 3 tan a 



tan 3a 
tan 4a 
tan na 



-3tan 2 a + l 
—4 tan 3 a + 4 tan a 
tan 4 a — 6 tan 2 a + 1 

tan (n — l)a + tan a 
— tan (n — l)a tan a + 1 



6.1.14 HALF-ANGLE FORMULAE 



cos ■ 



a / 1 + cos a 



2 V 2 

(positive if a/2 is in quadrant I or IV, negative if in II or III). 



. a 1 — cos a 

Sm 2 =± V^ _ 

(positive if a/2 is in quadrant I or II, negative if in III or IV). 



a 1 — cos a sin a 1 — cos a 

tan — = ; = = ±4/ 

2 sin a 1 + cos a V 1 + cos a 

(positive if a/2 is in quadrant I or III, negative if in II or IV). 



a 1 + cos a sin a 1 + cos a 

cot — = : = = ± \ / 

2 sin a 1 — cos a V 1 — cos a 

(positive if a/2 is in quadrant I or III, negative if in II or IV). 
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6.1.15 POWERS OF CIRCULAR FUNCTIONS 



sin 2 a = -(1 — cos 2a). 
2 V ' 

1 



tan a 



cos 2 a = ^(1 + cos 2a). 
1 



sin a = -(— sin 3a + 3sina). cos a = -(cos3a + 3cosa) 



sin 4 a = — (3 — 4 cos 2a + cos 4a) . cos 4 a = — (3 + 4 cos 2a + cos 4a) 



1 — cos 2a 
1 + cos 2a 



2 1 + cos 2a 

cot a = . 

1 — cos 2a 



6.1.16 PRODUCTS OF SINE AND COSINE 

cos a cos P = ^ cos (a — /3) + ^ cos (a + /?) . 

sin a sin /? = ^ cos (a — /?) — ^ cos (a + /?) . 
sin a cos /? = ^ sin (a — /?) + ^ sin (a + /3). 



6.1.17 SUMS OF CIRCULAR FUNCTIONS 



a±/3 a^/? 

sin a ± sin n = 2 sin cos . 

2 2 

a +/3 a-/? 
cos a + cos p = 2 cos — - — cos — - — . 

a + P . a- P 

cos a — cos a = —2 sin sin . 

2 2 



tan a ± tan /3 
cot a ± cot P 



sin a ± j8 
cos a cos /3 
sin P ± a 
sin a sin ft 



sin a + sin ft _ tan 

sin a- sin P tan ^ ' 

sin a + sin/? —a + P 
= cot . 

cos a — cos P 2 

sin a + sin /? a + P 
= tan — - — . 

cos a + cos P 2 

sin a — sin /? a — ft 
= tan — - — . 

cos a + cos P 2 
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6.2 CIRCULAR FUNCTIONS AND PLANAR 
TRIANGLES 




b b 
Right triangle General triangle 



6.2.1 RIGHT TRIANGLES 

Let A, B, and C designate the vertices of a right triangle with C the right angle and 
a, b, and c the lengths of the sides opposite the corresponding vertices. 

1. Trigonometric functions in terms of angle sides 

. a 1 
smA 



c esc A ' 

cos,4 = - = — !—, (6.2.1) 

c sec A 

tan A 



b cot A 

2. The Pythagorean theorem states that a 2 + b 2 = c 2 . 

3. The sum of the interior angles equals ir, i.e., A + B + C 



6.2.2 GENERAL PLANE TRIANGLES 

Let A, B, and C designate the interior angles of a general triangle and let a, b, and c 
be the length of the sides opposite those angles. 

1. Radius of the inscribed circle: 



(s-a)(s-b)(s-c)^ (622) 



where the semi-perimeter is 



s = 1 (a + b + c) . (6.2.3) 
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2. Radius of the circumscribed circle: 

a b c abc 



R 



2 sin A 2 sin 5 2sinC 4 (Are a) ' 
3. Law of sines: 



a 



sin A sin B sin C 

4. Law of cosines: 

a 2 = c 2 + b 2 — 26c cos A, cos A 

b 2 = a 2 + c 2 — 2cacosB, cosB 

c 2 = b 2 + a 2 — 2ab cos C, cos C 

5. Triangle sides in terms of other components: 

a = b cos C + c cos B, 
c = b cos A + a cos B, 
b = acosC + ccos A. 

6. Law of tangents: 



c 2 +b 2 - a 2 

2bc 
a 2 +c 2 - b 2 

2ca 
b + a — c 

2d> ' 



a + b 


tan 


A+B 

2 


a — b 


tan 


A-B 

2 


b + c 


tan 


B + C 
2 


b-c 


tan 


B-C 
2 


a + c 


tan 


A+C 
2 


a — c 


tan 


A-C 

1 



7. Area of general triangle: 

be sin A ac sin B ab sin C 



Area 



2 2 2' 

c 2 sin A sin £? 6 2 sin A sin C a 2 sin B sin C 



2sinC 2sinB 2sinA 

rs = — — = \/s(s — a)(s — b)(s — c) (Heron's formula). 
AR 



8. Mollweide's formulae: 



b 




c 


sin \ (B-C) 




a 




cos \A 


c 




a 


sin \(C - A) 




b 




cos \B 


a 




b 


sin \( A-B) 




c 




cos \C 
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9. Newton's formulae: 



b + c 


cos 2 \B — 


C) 


a 


1 i 

sm \A 




c + a 


cos\(C - 


A) 


b 


sin \B 




a + b 


cos \{A — 


B) 


c 


sin \C 





6.2.3 HALF-ANGLE FORMULAE 

A r Br C 

tan — = tan — = tan — 

2 s-a 2 s-b 2 





A 


sin 


2 ~ 




B 


sin 


~2 ~ 




C _ 


sin 






~2 ~ 





-b)(s 


-c) 


be 




-c)(s 


-a) 


ca 




-a)(s 


-b) 



ab 2 V ab 





tan ■ 




A 


cos 


~2 ~ 




B 


COS 


~2 ~ 




C _ 


COS 






2" ~ 



ls(s- 


a) 


bc 




b) 


ca 


'a(a - 


c) 



6.2.4 SOLUTION OF TRIANGLES 

A triangle is totally described by specifying any side and two additional parameters: 
either the remaining two sides (if they satisfy the triangle inequality), another side 
and the included angle, or two specified angles. If two sides are given and an angle 
that is not the included angle, then there might be 0, 1 , or 2 such triangles. Two angles 
alone specify the shape of a triangle, but not its size, which requires specification of 
a side. 



6.2.4.1 Three sides given 

Formulae for any one of the angles: 



c 2 +b' 2 -a 2 . „ 2 



cos A = — , sin A = — \/ s(s — a)(s — b)(s — c), 

2bc be 

. A l(s-b)(s-c) A 1 8 (8 - a) 

sin - = \ -, cos— = \ -, 

2 V be 2 V be ' 



A (s-b)(s-c) 
tan - = W V - A 
2 y s{s — a) 
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FIGURE 6.5 

Different triangles requiring solution. 



A 




C 



B 



6.2.4.2 Given two sides (b, c) and the included angle (A) 

See Figure 6.5, left. The remaining side and angles can be determined by repeated 
use of the law of cosines. For example, 

1. "Non-logarithmic solution"; perform these steps sequentially: 

(a) a 2 = b 2 + c 2 - 2bc cos A 

(b) cosB = (a 2 + c 2 - b 2 )/2ca 

(c) cosC = (a 2 +b 2 -c 2 )/2ba 

2. "Logarithmic solution"; perform these steps sequentially: 

(a) B + C = tt- A 

(b) tan • 

(c) B = 

(d) C = 

(e) a = . 

smB 



(B-C) 


b 


— c 
1 


2 

B + C 


b 
B 


+ c 
-C 


2 

B + C 


H 

B 


2 

-C 


2 

b sin A 




2 



(B + C) 



6.2.4.3 Given two sides (b, c) and an angle (C), not the included 
angle 

See Figure 6.5, middle. The remaining angles and side are determined by use of the 
law of sines and the fact that the sum of the angles is tt ( A + B + C = tt). 

. „ 6sinC . „ „ b sin A ^ „ , N 

sinB = , A = tt-B-C, a= . (6.2.4) 

c smB 

6.2.4.4 Given one side (b) and two angles (B, C) 

See Figure 6.5, right. The third angle is specified by A = tt — B — C. The remaining 
sides are found by 

b sin A b sin C 

a = . , c = . ■ (6.2.5) 
sin B sin B 
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6.2.5 TABLES OF TRIGONOMETRIC FUNCTIONS 



(degrees) 

X 


sin a; 


cos a; 


tan x 


cot X 


sec a; 


CSC X 












1 









±00 




1 




±00 


5 





0872 





9962 





0875 


11 


4300 


1 


0038 


11 


4737 


10 





1736 





9848 





1763 


5 


6713 


1 


0154 


5 


7588 


15 





2588 





9659 





2680 


3 


7321 


1 


0353 


3 


8637 


20 





3420 





9397 





3640 


2 


7475 


1 


0642 


2 


9238 


25 





4226 





9063 





4663 


2 


1445 


1 


1034 


2 


3662 


30 





5000 





8660 





5774 


1 


7321 


1 


1547 


2 


0000 


35 





5736 





8192 





7002 


1 


4282 


1 


2208 


1 


7434 


40 





6428 





7660 





8391 


1 


1918 


1 


3054 


1 


5557 


45 





7071 





7071 


1 


0000 


1 


0000 


1 


4142 


1 


4142 


50 





7660 





6428 


1 


1918 





8391 


1 


5557 


1 


3054 


55 





8192 





5736 


1 


4282 





7002 


1 


7434 


1 


2208 


60 





8660 





5000 


1 


7321 





5774 


2 


C\C\C\C\ 

0000 


A 
1 


1547 


DO 





9063 





4226 


2 


1445 





4663 


2 


3662 


1 


1034 


/ u 





9397 





3420 


2 


7475 





3640 


2 


9238 


1 


0642 


ID 





9659 





2588 


3 


7321 





2680 


3 


8637 


A 
1 


no ET o 

0353 


on 

oU 


o 


9848 


o 


1736 


5 


6713 


o 


1763 


5 


7588 




0154 


80 





9962 





0872 


11 


4300 





0875 


11 


4737 


1 


0038 


90 




1 









±00 









±00 




1 


1UO 





9659 


— 


2588 


—3 


7321 


— 


2680 


—3 


8637 


1 


0353 


i on 





8660 


— 


5000 


— 1 


7321 


— 


5774 


—2 


0000 


1 


1547 


i or 

loo 





7071 


— 


7071 


— 1 


0000 


— 1 


0000 


— 1 


4142 


1 


A A A O 

4142 


10U 


o 


5000 


— 


8660 


— 


5774 


_1 


7321 


_1 


1547 


2 


0000 


1DO 





2588 


-0 


9659 


-0 


2680 


-3 


7321 


-1 


0353 


3 


8637 


180 









-1 









±00 




-1 




±00 


inr 

iyo 


— 


2588 


— 


9659 





2680 


3 


7321 


— 1 


0353 


—3 


8637 


oi n 


— 


5000 


— 


8660 





5774 


1 


7321 


— 1 


1547 


—2 


0000 




— 


7071 


— 


7071 


1 


0000 


1 


0000 


— 1 


A "1 A O 

4142 


— 1 


A "1 A O 

4142 


O/i n 


n 
— u 


OUUU 


n 
— u 


OUUU 


1 
1 


7391 
i OZ 1 


n 
u 




o 

— L 


uuuu 


i 

— i 




ZOO 


-0 


9659 


-0 


2588 


3 


7321 





2680 


-3 


8637 


-i 


0353 


270 




-1 









±00 









±00 




-1 


285 


-0 


9659 





2588 


-3 


7321 


-0 


2680 


3 


8637 


-i 


0353 


300 


-0 


8660 





5000 


-1 


7321 


-0 


5774 


2 


0000 


-i 


1547 


315 


-0 


7071 





7071 


-1 


0000 


-1 


0000 


1 


4142 


-i 


4142 


330 


-0 


5000 





8660 


-0 


5774 


-1 


7321 


1 


1547 


-2 


0000 


345 


-0 


2588 





9659 


-0 


2680 


-3 


7321 


1 


0353 


-3 


8637 


360 









1 









±00 




1 




±00 
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(radians) 

X 


sin a; 


cos a; 


tana; 


cot X 


sec a; 


esc a; 


o 









1 







±00 




1 




±00 


0.1 





0998 





9950 





1003 


9.9666 


1 


0050 


10 


0167 


0.2 





1987 





9801 





2027 


4.9332 


1 


0203 


5 


0335 


0.3 





2955 





9553 





3093 


3.2327 


1 


0468 


3 


3839 


0.4 





3894 





9211 





4228 


2.3652 


1 


0857 


2 


5679 


0.5 





4794 





8776 





5463 


1.8305 


1 


1395 


2 


0858 


0.6 





5646 





8253 





6841 


1.4617 


1 


2116 


1 


7710 


0.7 





6442 





7648 





8423 


1.1872 


1 


3075 


1 


5523 


0.8 





7174 





6967 


1 


0296 


0.9712 


1 


4353 


1 


3940 


0.9 





7833 





6216 


1 


2602 


0.7936 


1 


6087 


1 


2766 


1.0 





8415 





5403 


1 


5574 


0.6421 


1 


8508 


1 


1884 


1.1 





8912 





4536 


1 


9648 


0.5090 


2 


2046 


1 


1221 


1.2 





9320 





3624 


2 


5722 


0.3888 


2 


7597 


1 


0729 


1.3 





9636 





2675 


3 


6021 


0.2776 


3 


7383 


1 


0378 


1.4 





9854 





1700 


5 


7979 


0.1725 


5 


8835 


1 


0148 


1.5 





9975 





0707 


14 


1014 


0.0709 


14 


1368 


1 


0025 


7T/2 




1 









±00 


o 




±00 




1 


1.6 





9996 


-0 


0292 


-34 


2325 


-0.0292 


-34 


2471 


1 


0004 


1.7 





9917 


-0 


1288 


-7 


6966 


-0.1299 


-7 


7613 


1 


0084 


1.8 





9738 


-0 


2272 


-4 


2863 


-0.2333 


-4 


4014 


1 


0269 


1.9 





9463 


-0 


3233 


-2 


9271 


-0.3416 


-3 


0932 


1 


0567 


2.0 





9093 


-0 


4161 


-2 


1850 


-0.4577 


-2 


4030 


1 


0998 


2.1 





8632 


-0 


5048 


-1 


7098 


-0.5848 


-1 


9808 


1 


1585 


2.2 





8085 


-0 


5885 


-1 


3738 


-0.7279 


-1 


6992 


1 


2369 


2.3 





7457 


-0 


6663 


-1 


1192 


-0.8935 


-1 


5009 


1 


3410 


2.4 





6755 


-0 


7374 


-0 


9160 


-1.0917 


-1 


3561 


1 


4805 


2.5 





5985 


-0 


8011 


-0 


7470 


-1.3386 


-1 


2482 


1 


6709 


2.6 





5155 


-0 


8569 


-0 


6016 


-1.6622 


-1 


1670 


1 


9399 


2.7 





4274 


-0 


9041 


-0 


4727 


-2.1154 


-1 


1061 


2 


3398 


2.8 





3350 


-0 


9422 


-0 


3555 


-2.8127 


-1 


0613 


2 


9852 


2.9 





2392 


-0 


9710 


-0 


2464 


-4.0584 


-1 


0299 


4 


1797 


3.0 





1411 


-0 


9900 


-0 


1425 


-7.0153 


-1 


0101 


7 


0862 


3.1 





0416 


-0 


9991 


-0 


0416 


-24.0288 


-1 


0009 


24 


0496 


7T 









-1 







±00 




-1 




±00 



© 2003 by CRC Press LLC 



6.3 INVERSE CIRCULAR FUNCTIONS 



6.3.1 DEFINITION IN TERMS OF AN INTEGRAL 



arc sm(z) = sin 1 z = \ 
Jo 

arc cos(2;) = cos -1 z = f = TT ~ si 11 " 1 z , (6.3.1) 

Jz V 1 - t 2 2 

arc tan(z) = tan -1 z = / — 
io 1 



dt 



















+ i 2 2 



cot 1 z 



where z can be complex. The path of integration must not cross the real axis in 
the first two cases. In the third case, it must not cross the imaginary axis except 
possibly inside the unit circle. If — 1 < x < 1, then sin -1 x and cos -1 x are real, 
— f < sin -1 x < f , and < cos -1 x < tt. 



esc 1 z = sin 1 (\/z), 
sec -1 z = cos~ 1 (l/z), 



(6.3.2) 

cot z = tan (1/z), 

sec -1 z + esc -1 z = 7r/2. 



6.3.2 PRINCIPAL VALUES OF THE INVERSE CIRCULAR 
FUNCTIONS 

The general solutions of {sini = z, cost = z, tani = z} are, respectively: 

t = sin -1 z = (—l) k to + kit, with sint = z, 

t = cos -1 z = ±ti + 2kir, with sinii = z, 

t = tan -1 z = ti + kn, with sini 2 = z, 

where k is an arbitrary integer. While "sin -1 x" can denote, as above, any angle 
whose sin is x, the function sin -1 x usually denotes the principal value. The princi- 
pal values of the inverse trigonometric functions are defined as follows: 



I. 


When 


-1 < 


X 


<1, 


then 


— 7r/2 < sin - 


i 


X 


< tt/2. 


2. 


When 


-1 < 


X 


< 1, 


then 


< cos" 


-l 


X 


< TT- 


3. 


When 


— 00 < 


X 


< 00, 


then 


— 7r/2 < tan" 


-l 


X 


< tt/2 


4. 


When 


1 < 


X. 




then 


< esc" 


■ i 


X 


< tt/2. 




When 




X 


< -1, 


then 


— 7r/2 < esc" 


-l 


X 


< o. 


5. 


When 


1 < 


X. 




then 


< sec" 


-l 


X 


< tt/2- 




When 




X 


< -1, 


then 


7r/2 < sec" 


-l 


X 


< TT- 


6. 


When 


— 00 < 


X 


< 00, 


then 


< cot" 


-i 


X 


< TT- 
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6.3.3 FUNDAMENTAL IDENTITIES 

sin -1 x + cos -1 x = 7r/2. 
tan -1 x + cot -1 x = tt/2. 

If a = sin -1 x, then 

sina;=a;, cos a = \/l — x 2 , tana 



1 1 vT 

esc a = — , sec a = . cot a = 



x 



If a = cos 1 a;, then 



sin a = — x 2 , cos a = x, tan a = — 

x 

1 1 x 

esc a = . sec a = — , cot a 



\/l - x 2 ' x' Vl - x 2 



If a = tan 1 x, then 



sing = ; , cos a = , . tan a = x, 

VTTx 2 VTTx 2 

esc a = , seca = yl+x , cota = — . 

a; a; 

6.3.4 FUNCTIONS OF NEGATIVE ARGUMENTS 

sin -1 (— z) = — sin -1 z, sec -1 (— z) = 7r — sec -1 z, 

COS -1 ( — z) = 7T — COS -1 Z, CSC -1 ( — z) = — CSC _1 Z, 

tan -1 (— z) = — tan -1 z, cot -1 (— z) = tt — cot -1 z. 



6.3.5 RELATIONSHIP TO INVERSE HYPERBOLIC FUNCTIONS 

sin -1 z = — i sinh -1 (iz), esc -1 z = i csch -1 (iz), 

tan -1 z = — i tanh -1 (iz), cot -1 z = i coth -1 (iz). 
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6.3.6 SUM AND DIFFERENCE OF TWO INVERSE CIRCULAR 
FUNCTIONS 

sin -1 z\ ± sin -1 z-i = sin -1 \j\ — z\ ± zi\j^- — zj^j . 

cos -1 z\ ± cos -1 zi = cos -1 ^12:2 ^ ^/(l — )(1 — ^1)^ • 

-1 -1 -1 ( z \ =t 2; 2 A 

tan zi ± tan 22 = tan . 

\lTZiz 2 J 

sin -1 ± cos -1 z-i = sin -1 ^21 £2 ± <\J (1 — zj)(l — ~z%)J , 
= cos" 1 ^2^/1 -^1 Tzi^l -z£j. 

, -1 , .-1 . _i^l^2±l\ , -1 / Z 2 =F Zl \ 

tan z\ ± cot 22 = tan = cot . 

V z-2 T z\ J \ziz 2 ± I J 

6.4 CEILING AND FLOOR FUNCTIONS 

The ceiling function of x, denoted \x] , is the least integer that is not smaller than x. 
For example, |~7r] = 4, [5] = 5, and [—1.5] = —1. 

The floor function of x, denoted [x\ , is the largest integer that is not larger 
than a;. For example, [tt\ = 3, |_5J = 5, and |_ — 1.5J = -2. 

6.5 EXPONENTIAL FUNCTION 



6.5.1 EXPONENTIATION 

For a any real number and to a positive integer, the exponential a m is defined as 

a m = a - a - a - ■ ■ a . (6.5.1) 
v v ' 

m terms 

The following three laws of exponents follow for a ^ 0: 



„ a"" 
2- — = { 



a m ~ n , if to > n, 
1, if to = n, 

„J- m , if to < n. 
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3. ( a m ) n = a (mn \ 

The n th root function is defined as the inverse of the n th power function: 

If b n = a, then b = = a (1/n) . (6.5.2) 

If n is odd, there will be a unique real number satisfying the above definition of 
y^a, for any real value of a. If n is even, for positive values of a there will be two 
real values for ^/a, one positive and one negative. By convention, the symbol yfa 
means the positive value. If n is even and a is negative, then there are no real values 
for \fa. 

To extend the definition to include a* (for t not necessarily a positive integer) so 
as to maintain the laws of exponents, the following definitions are required (where 
we now restrict a to be positive; p and q are integers): 



1 aPlo = tftiP 



1 



(6.5.3) 



With these restrictions, the second law of exponents can be written as — = a m ". 

If a > 1, then the function a x is monotonically increasing while, if < a < 1 
then the function a x is monotonically decreasing. 



6.5.2 DEFINITION OF e z 

exp(z) = e z = 



( i+ -y 

V TO/ 



lim 

m— >oo 

Z 2 Z 3 Z A 

1 + 2+ 2! + 3! + 4! + ' 



If z = x + iy, then e z = e x e w = e x (cosy + i siny). 
The numerical value of e is given on page 15. 

20 
15 
10 

5 




1 1 


1 1 \ 




e -x ..../_ 


1 J 







x 



(6.5.4) 



6.5.3 DERIVATIVE AND INTEGRAL OF e* 

The derivative of e x is e x . The integral of e x is e x . 
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6.6 LOGARITHMIC FUNCTIONS 



6.6.1 DEFINITION OF THE NATURAL LOGARITHM 

The natural logarithm (also known as the Napierian logarithm) of z is written as In z 
or as log e z. It is sometimes written log z (this is also used to represent a "generic" 
logarithm, a logarithm to any base). One definition is 

\nz = £j, (6.6.1) 

where the integration path from 1 to z does not cross the origin or the negative real 
axis. 

For complex values of z the natural logarithm, as defined above, can be repre- 
sented in terms of its magnitude and phase. If z = x + iy = re t9 , then 

lnz = lnr + i(6 + 2kit), (6.6.2) 



for some k = 0, ±1, . . ., where r = \j x 2 + y 2 , x = rcos9, and y = r sin#. 
Usually, the value of k is chosen so that < (9 + 2kir) < 2tt. 

6.6.1 .1 Logarithms to a base other than e 

The logarithmic function to the base a, written log a , is defined as 

logt z In z 
\og a z = -^ = —. (6.6.3) 
log;, a ma 

Note the properties: 

1. log a af =p. 

2. log a 6 1 



log(,a 

3. log 10 ^ = = (log 10 e)lnz ?s (0.4342944819) ln^. 

4. \nz = (In 10) log 10 z w (2.3025850929) log 10 z. 



6.6.2 LOGARITHM OF SPECIAL VALUES 



InO = — oo, In 1 = 0, ln( 

ln(-l) = wr + 2irik. In (±i) = ±— + 2mk. 
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6.6.3 RELATING THE LOGARITHM TO THE EXPONENTIAL 



For real values of z the logarithm is a monotonic function, as is the exponential. Any 
monotonic function has a single-valued inverse function; the natural logarithm is the 
inverse of the exponential. If x = e v , then y = \nx, and x = e lnx . The same 
inverse relations hold for bases other than e. That is, if u = a w , then w = \og a u, 
andu = a l0 ^". 



6.6.4 IDENTITIES 

log a Z!Z 2 = log a zi + log a z 2 , for (-7T 

log a — =log a zi -log a z 2 , for(-7r 

\og a z n =n\og a z, for(-7r 



< arg z\ + arg z 2 <tt). 

< arg z\ - arg z 2 <w). 

< n arg z < tt), when n is an integer. 



6.6.5 SERIES EXPANSIONS FOR THE NATURAL LOGARITHM 

ln(l + z) = z - ]-z 2 + l-z 3 - . . . , for \z\ < 1. 

. z - 1\ 1 ( z - 1\ 2 1 ( z - 1\ 3 r „ 1 

\mz=\ )+-( I +-( I +..., forRez>-. 



6.6.6 DERIVATIVE AND INTEGRATION FORMULAE 

dlriz 1 

dz z ' 



J — = In z , J \n z dz = z\n z — z . 
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6.7.1 DEFINITIONS OF THE HYPERBOLIC FUNCTIONS 



sinhz 
cosh z 
tanh z 



2 

e z + e~ 
2~ 

e z — e~ 



sinh z 



When z = x + iy, 

sinh z = sinh a; cos y + i cosh a; sin y , 

cosh z = cosh x cos y + i sinh x sin j/, 



cschz 
sechz 
cothz 



1 



sinhz 
1 

cosh z ' 
1 



tanh z 
cothz 



tanh z 

sinh 2x + i sin 2y 
cosh 2x + cos 2y ' 
sinh 2x — i sin 2y 
cosh 2a; — cos 2y ' 



6.7.2 RANGE OF VALUES 



Function 


Domain 
(interval of u) 


Range 
(interval of function) 


Remarks 


sinhu 


(-00, +oo) 


(-oo, +oo) 




coshu 


(-oo, +oo) 


[1, +oo) 




tanhu 


(-00, +00 ) 


(-++1) 




cschu 


(-oo,0) 


(0,-co) 


Two branches, 




(0,+oo) 


(+oo,0) 


pole at u = 0. 


sechu 


(—'00', +oo) 


(0,1] 




cothu 


(-oo,0) 


(-l,-oo) 


Two branches, 




(0,+oo) 


( + 00,1) 


pole at u = 0. 



6.7.3 HYPERBOLIC FUNCTIONS IN TERMS OF ONE ANOTHER 



Function 


sinh a; 


cosh a; 


tanh a; 








tanh a; 


sinh a; = 


sinh a; 


±^/(cosh a;) 2 


- 1 




— (tanh a;) 2 
1 


cosh a; = 


y/1 + (sinh a;) 2 


cosh a; 










— (tanh a;) 2 


tanh a; = 


sinh a; 


^/(cosha;) 2 


- 1 




tanh a; 


y/l + (sinh a;) 2 


cosh a; 






cscha; = 


1 


1 

± — 




x/i 


— (tanh a;) 2 


sinh a; 
1 


^/(cosha;) 2 
1 


- 1 


tanh a; 


secha; = 






— (tanh a;) 2 


y/l + (sinh a;) 2 


cosh a; 




cotha; = 


y/1 + (sinhx) 2 


cosh x 






1 


sinh a; 


^/(cosha;) 2 


- 1 




tanh a; 
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Function 


cscha; 


secha; 


cotha; 


sinh a; = 
cosh a; = 
tanh a; = 
cscha; = 
secha; = 
cotha; = 


1 


\/l — (secha;) 2 


1 


cscha; 
\j (cscha;) 2 + 1 


sech a; 
1 


V(cotha;) 2 - 1 
coth x 


cscha; 
1 

^/(csch a;) 2 + 1 
cscha; 
cscha; 


secha; 

±y/l — (secha;) 2 

secha; 

± - 

V 1 — (secha;) 2 

secha; 

1 

VI -(secha;) 2 


V(cotha;) 2 - 1 
1 

cotha; 
±7(cotha;) 2 - 1 
^/(cotha;) 2 - 1 

_|_ V v / 


^/(cscha;) 2 + 1 


cotha; 
coth x 



6.7.4 RELATIONS AMONG HYPERBOLIC FUNCTIONS 

e z = cosh z + sinh z, e _z = cosh z — sinh z, 
(coshz) 2 — (sinhz) 2 = (tanhz) 2 + (sechz) 2 = (cothz) 2 — (cschz) 2 = 1. 



6.7.5 RELATIONSHIP TO CIRCULAR FUNCTIONS 

cosh z = cos iz, sinh z = — i shiiz, taxihz = —itaxiiz. 



6.7.6 SERIES EXPANSIONS 







z 2 




z 4 


z e 






cosh z 


= 1 + 


2! 


+ 


4! + 


6I + "' 


\A 


< 00 


sinh z 


= z + 


z 3 
3! 


+ 


z 5 

5! + 


z 7 

7I + "' 


\A 


< 00 


tanh z 


= z — 


z 3 
3 


+ 


2z 5 
IT ' 


17 z 7 

315 + "' 


\A 


7T 

<2- 



6.7.7 SYMMETRY RELATIONSHIPS 

cosh (— z) = + cosh z, sinh (— z) = — sinh z, tanh (— z) = — tanh z. 
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6.7.8 SUM AND DIFFERENCE FORMULAE 

cosh (z\ ±2-2)= cosh z\ cosh £2 ± sinh 2: 1 sinh £2, 
sinh (z\ ±2-2)= sinh z\ cosh z<i ± cosh z\ sinh z 2 , 

tanh z\ ± tanh Z2 sinh 2;zi ± sinh 2z2 



tanh (zi ± ^2) 
coth (z\ ± £2) 



1 ± tanh z\ tanh z 2 cosh 2z\ ± cosh 2^2 ' 
1 ± coth z\ coth Z2 sinh 2;zi + sinh 2z2 
coth z\ ± coth Z2 cosh 2;zi — cosh 2z2 



6.7.9 MULTIPLE ARGUMENT RELATIONS 

2 tanh a 



sinh 2a = 2 sinh a cosh a 



1 — tanh 2 a 



sinh 3a = 3 sinh a + 4 sinh a = sinh a(4 cosh a — 1). 

sinh 4a = 4 sinh 3 a cosh a + 4 cosh 3 a sinh a. 

cosh 2a = cosh 2 a + sinh 2 a = 2 cosh 2 a — 1, 

_ . , 2 1 + tanh 2 a 

= 1 + 2 sinh a = ^ — . 

1 — tanh a 

cosh 3a = —3 cosh a + 4 cosh 3 a = cosh a(4 sinh 2 a + 1). 
cosh 4a = cosh 4 a + 6 sinh 2 a cosh 2 a + 6 sinh 4 a. 
2 tanh a 



tanh 2a 
tanh 3a 
coth 2a 
coth 3a 



1 + tanh 2 a 

3 tanh a + tanh 3 a 

1 + 3 tanh 2 a 
1 + coth 2 a 

2 coth a 
3 coth a + coth 3 a 

1 + 3 coth 2 a 



6.7.10 SUMS OF FUNCTIONS 



sinh u ± sinh w = 2 sinh — — — cosh - U 

2 

, u + w 

cosh u + cosh w = 2 cosh — - — cosh 



cosh u — cosh w = 2 sinh — - — sinh 
sinh u ± w 

tanh u ± tanh w 





2 ' 


u 


— w 




2 


u 


— w 


2 ' 



coth u ± coth w 



cosh u cosh w ' 

sinh u ± w 
sinh u sinh w ' 
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6.7.1 1 PRODUCTS OF FUNCTIONS 

sinhwsinhw = ^ (cosh(w + w) — cosh(w — w)) , 

sinhwcoshw = ^ (sinh(w + w) + sinh(w — w)) , 
cosh u cosh w = ^ (cosh(u + w) + cosh(u — w) ) . 



6.7.12 HALF-ARGUMENT FORMULAE 



. , z /cosh^ — 1 z /coshz + l 

smh- = ±W , cosh- = +W . 

2 V 2 2 V 2 



, z /cosh^ — 1 sinhz , z /coshz + l sinhz 

tanh- = ±W - = -, coth- = ±i 



2 V cosh z + 1 cosh z + 1 ' 2 V cosh z — 1 cosh z — 1 



6.7.13 DIFFERENTIATION FORMULAE 

cfeinhz , efcoshz . 

— = coshz, = sinhz, 

dtanhz , , 2 cfcschz 

= (sechz) , — = — cschzcothz, 

dz dz 

dsechz , , cfcothz , , 

— = — sechztanhz, = — (cschz) . 

dz dz 



6.8 INVERSE HYPERBOLIC FUNCTIONS 

, -i f" dt . , _! f z dt , _! /- z dt 
cosh z = , sinn z = , tanh z = / -. 



6.8.1 RANGE OF VALUES 



Function 


Domain 


Range 


Remarks 


sinh -1 u 


(—00, +'00 ) 


(-'00', +oo) 


Odd function 


cosh -1 u 


[l,+oo) 


( — '00', +oo) 


Even function, double valued 


tanh -1 u 




(-'00', +oo) 


Odd function 


csch -1 u 


(-oo,0), (0,oo) 


(0,-oo), (oo,0) 


Odd function, two branches, 








Pole at u = 


sech -1 u 


(0,1] 


(-'00', +00 ) 


Double valued 


coth -1 u 


(-oo,-l), (l,oo) 


(-oo,0), (oo,0) 


Odd function, two branches 
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6.8.2 RELATIONSHIPS AMONG INVERSE HYPERBOLIC 
FUNCTIONS 



tanh 1 



Function 



sinh 1 x 



cosh 1 x 



x 



sinh 1 x - 

cosh -1 x 
tanh -1 x 

csch -1 x ■ 

sech -1 x ■ 

coth -1 x 



sinh 1 



a; 



± sinh 1 Va: 2 — 1 

sinh -1 . = 

VT^ 

sinh -1 — 

x 

± sinh -1 ^HZ 

x 

sinh -1 . 

Vx^l 



± cosh 1 \Jx 2 + 1 
cosh -1 a; 



± cosh 1 



1 



tanh . 

±tanh -i^EI 



tanh 1 



a; 
a; 



± cosh" 



-1 VTT~ 



cosh" 



± cosh 1 



-i 1 



Vx^l 



tanh 1 . 

VI + x 1 

±tanh -1 VI -x 2 

tanh -1 — 

x 



Function 



csch 1 . 



sech 1 



coth 1 



sinh -1 x 
cosh -1 x - 

tanh -1 x 
csch -1 x - 
sech -1 x - 
coth -1 x - 



csch 



-i 1 



± sech' 



-i 1 



± csch" 



x 

-i 1 



VI + x 2 



coth' 



_i VTT. 



csch' 



Vx 2 ^! 
_! VT^x 2 



sech" 



-i 1 



csch 1 . 



± csch 1 



vr 



± sech 1 Vl — a; 2 



± sech 1 ; ^ 

VTTa? 

sech -1 a; 



±coth -1 



coth 



Vx^l 
-i 1 



coth 1 Vl + a; 2 
-i 1 



± coth 



vr 



csch 1 Va; 2 — 1 



sech" 



_! Va; 2 - 1 



coth 1 
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6.8.3 RELATIONSHIPS WITH LOGARITHMIC FUNCTIONS 

sinh -1 x = log (x + \J x 2 + , csch -1 x = lo, 



i±VT+ 



2 



X 



cosh" 



_1 x = log (x ± a/^ 2 — lj j sec h 1 a; = log 



'l ± VI -x 2 ^ 



tanh -1 * = I log (I±£) , coth -1 , = 1 log (i±l) . 

6.8.4 RELATIONSHIPS WITH CIRCULAR FUNCTIONS 

sinh -1 x = — i sin -1 ix sinh -1 ix = +i sin -1 x 

tanh -1 x = — i tan -1 ix tanh -1 ix = +i tan -1 x 

csch -1 x = +i esc -1 ix csch -1 ix = —i esc -1 x 

coth -1 x = +i cot -1 ix coth -1 ix = —i cot -1 x 



6.8.5 SUM AND DIFFERENCE OF FUNCTIONS 

sinh -1 x ± sinh -1 y = sinh -1 {x\/l + y 2 ± yy/l + x 2 ^ , 

cosh -1 x ± cosh -1 y = cosh -1 (xy ± \J (y 2 — l)(x 2 — 1) j , 

tanh -1 x ±tanh -1 y = tanh -1 | - — - ) , 

\xy±lj 

sinh -1 x ± cosh -1 y = sinh -1 (xy ± \/ (1 + x 2 )(y 2 — 1) j , 
= cosh -1 (y\/l + x 2 ± x\/y 2 — , 

i-l i-l i -l ( X V i 

tanh x ± coth y = tanh , 

\y±x J 

=coth -i f»±£.y 
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6.9 GUDERMANNIAN FUNCTION 




This function relates circular and hyperbolic functions without the use of functions 
of imaginary argument. The Gudermannian is a monotonic odd function which is 
asymptotic to ±| as x — > ±oc. It is zero at the origin. 



gda; 



gd x 



the Gudermannian of x 

dt 



L 



coshi 



2 tan" 



'(tanhf) 



2tan"V 



7T 

2' 



the inverse Gudermannian of x 
dt 



f = log [tan + ^1 = log (sec x + tan x) . 

J cost L \4 2/1 



If gd(a; + iy) = a + i(3, then 

sinha; 



tana 
tanh a; 



cosy 
sin a 
cosh j3 ' 



tanh j3 
tany 



sinj/ 
cosh x ' 

sin f3 
cosh a 



(6.9.1) 



6.9.1 FUNDAMENTAL IDENTITIES 

tanh — = tan 



(I) 



2 

e x = cosh a; + sinha; = sec gda; + tan gda;, 

'tt gdx\ 1 + sin (gda;) 
tan — ' 1 — 



^4 2 J cos(gda;) 
i gd -1 x = gd _1 (ia;), where i = \/— 1- 



6.9.2 DERIVATIVES OF GUDERMANNIAN 

d(gdx) eZ(gd _1 a;) 

= secha; = sec a;. 

dx dx 
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6.9.3 RELATIONSHIP TO HYPERBOLIC AND CIRCULAR 
FUNCTIONS 



sinha; = tan (gda;), 
cosh a; = sec (gda;), 
tanha; = sin (gda;), 



csch x = cot (gd x) , 
sech x = cos (gd x) , 
cotha; = esc (gda;). 



6.9.4 NUMERICAL VALUES OF HYPERBOLIC FUNCTIONS 



X 


e x 


In a; 


gda; 


sinha; 


cosh a; 


tanha; 







1 




— 00 














1 










1 


1.1052 


-2 


3026 





0998 





1002 


1 


0050 





0997 





2 


1.2214 


-1 


6094 





1987 





2013 


1 


0201 





1974 





3 


1.3499 


-1 


2040 





2956 





3045 


1 


0453 





2913 





4 


1.4918 


-0 


9163 





3897 





4108 


1 


0811 





3799 





5 


1.6487 


-0 


6931 





4804 





5211 


1 


1276 





4621 





6 


1.8221 


-0 


5108 





5669 





6367 


1 


1855 





5370 





7 


2.0138 


-0 


3567 





6490 





7586 


1 


2552 





6044 





8 


2.2255 


-0 


2231 





7262 





8881 


1 


3374 





6640 





9 


2.4596 


-0 


1054 





7985 


1 


0265 


1 


4331 





7163 


1 





2.7183 


-0 


0000 





8658 


1 


1752 


1 


5431 





7616 


1 


1 


3.0042 





0953 





9281 


1 


3356 


1 


6685 





8005 


1 


2 


3.3201 





1823 





9857 


1 


5095 


1 


8107 





8337 


1 


3 


3.6693 





2624 


1 


0387 


1 


6984 


1 


9709 





8617 


1 


4 


4.0552 





3365 


1 


0872 


1 


9043 


2 


1509 





8854 


1 


5 


4.4817 





4055 


1 


1317 


2 


1293 


2 


3524 





9051 


1 


6 


4.9530 





4700 


1 


1724 


2 


3756 


2 


5775 





9217 


1 


7 


5.4739 





5306 


1 


2094 


2 


6456 


2 


8283 





9354 


1 


8 


6.0496 





5878 


1 


2432 


2 


9422 


3 


1075 





9468 


1 


9 


6.6859 





6419 


1 


2739 


3 


2682 


3 


4177 





9562 


2 





7.3891 





6931 


1 


3018 


3 


6269 


3 


7622 





9640 


2 


1 


8.1662 





7419 


1 


3271 


4 


0219 


4 


1443 





9705 


2 


2 


9.0250 





7885 


1 


3501 


4 


4571 


4 


5679 





9757 


2 


3 


9.9742 





8329 


1 


3709 


4 


9370 


5 


0372 





9801 


2 


4 


11.0232 





8755 


1 


3899 


5 


4662 


5 


5569 





9837 


2 


5 


12.1825 





9163 


1 


4070 


6 


0502 


6 


1323 





9866 


2 


6 


13.4637 





9555 


1 


4225 


6 


6947 


6 


7690 





9890 


2 


7 


14.8797 





9933 


1 


4366 


7 


4063 


7 


4735 





9910 



continued on next page 
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continued from previous page 


X 


e x 


In a; 


gda; 


sinha; 


cosh a; 


tanha; 


2.8 


16.4446 


1.0296 


1.4493 


8.1919 


8.2527 


0.9926 


2.9 


18.1741 


1.0647 


1.4609 


9.0596 


9.1146 


0.9940 


3.0 


20.0855 


1.0986 


1.4713 


10.0179 


10.0677 


0.9951 


3.1 


22.1980 


1.1314 


1.4808 


11.0765 


11.1215 


0.9959 


3.2 


24.5325 


1.1632 


1.4893 


12.2459 


12.2866 


0.9967 


3.3 


27.1126 


1.1939 


1.4971 


13.5379 


13.5748 


0.9973 


3.4 


29.9641 


1.2238 


1.5041 


14.9654 


14.9987 


0.9978 


3.5 


33.1155 


1.2528 


1.5104 


16.5426 


16.5728 


0.9982 


3.6 


36.5982 


1.2809 


1.5162 


18.2855 


18.3128 


0.9985 


3.7 


40.4473 


1.3083 


1.5214 


20.2113 


20.2360 


0.9988 


3.8 


44.7012 


1.3350 


1.5261 


22.3394 


22.3618 


0.9990 


3.9 


49.4024 


1.3610 


1.5303 


24.6911 


24.7113 


0.9992 


4.0 


54.5982 


1.3863 


1.5342 


27.2899 


27.3082 


0.9993 



6.10 ORTHOGONAL POLYNOMIALS 

Orthogonal polynomials are classes of polynomials, {p n (x)}, which obey an orthog- 
onality relationship of the form 

J w{x) p n {x) p m {x) dx = c n S nm (6.10.1) 

for a given weight function w(x) and interval I. 

6.10.1 HERMITE POLYNOMIALS 

Symbol: H n (x). 
Interval: (—00,00). 

Differential equation: y" — 2xy' + 2ny = 0. 



L«/2J 



(-l) m n\(2x) 



Explicit expression: H n (x) = > . 

^— ' m\(n — 2m)\ 

Recurrence relation: H n+ i(x) = 2xH n (x) — 2nH n _i(x). 
_ 2 

Weight: e x . 

Standardization: H n (x) = 2 n x n + . . . . 

/oo 
e~ x2 [H n {x)f dx = 2™n! v / 7r. 
-OO 

2 d U 2 

Rodrigues' formula: H n (x) = (-l) n e x - — (e x ). 

dx n 

00 n 

Ez 2 
H n (x)— = e~ z +2zx . 
n\ 

n=0 
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Inequality: \H n {x)\ < V2 n e x2 n\. 



6.10.2 JACOBI POLYNOMIALS 

Symbol: Pt' 0) (x). 
Interval: [—1,1]. 

Differential equation: (l-x 2 )y" + [l3-a-(a+(3 + 2)x]y' + n(n + a+(3 + l)y = 0. 
Explicit expression: 

2« v m l\n — mj 

m=o v 7 v 7 

Recurrence relation: 2(n + l)(n + a + ft + l)(2n + a + ft)i^+f ) (x) 

= (2n + a + + l)[(a 2 - ft 2 ) + (2n + a + ft + 2)(2n + a + ft)^"'^ (a;) 

- 2(n + a)(n + ft)(2n + a + ft + 2)pj*?\x). 

Weight: (1 - x) a (l + xf . 

Standardization: P^\l) 



fi 

Norm: 



n + a 
n 



(l-x) a (l+x) p [P^fa)] dx 



2 a +P +1 T(n + a + l)r(n + ft + 1) 
(2n + a + ft + l)n!r(n + a + ft + 1) ' 

Rodriguez' formula: P^\x) = - V [(1 - x)" +a (l + x)" +/3 l . 

" 2"n!(l -x) a (l + dx™ LV ' ' 1 

CO 

Generating function: ^ P^ a '^(a;)z n = 2 a+/3 iT 1 (l - z + i?)" a (l + z + R)~ , 

n=0 

where R = \/\ — 2xz + z 2 and \z\ < 1. 

; n +«)~ n«, if 9 = max(a,ft) > -i, 

Pi a ' \x') ~ n" 1 / 2 , if 9 = max(a,ft) < -± 



Inequality: max 

-1<1<1 



where a, ft > 1 and a;' (in the second result) is one of the two maximum points 
nearest (ft - a) /(a + ft + 1). 



6.10.3 LAGUERRE POLYNOMIALS 

Symbol: L n (x). 
Interval: [0, oo). 

L n (x) is the same as (x) (see the generalized Laguerre polynomials). 



6.10.4 GENERALIZED LAGUERRE POLYNOMIALS 

Symbol: L^(x). 
Interval: [0, oo). 

Differential equation: xy" + (a + 1 — x)y' + ny = 0. 
Explicit expression: (x) = ^ - — -j — + a \ ^ m 
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Recurrence relation: 

(n + l)4+i (x) = [(2n + a + 1) - a;]4 a) (a;) - (n + • 
Weight: x a e~ x . 

(—1)™ 

Standardization: (x) = ; — x" + . . . . 

oo n! 

Aform: J°° x a e~ x [^(x)] 2 dx = F( " + J + ^ . 

° 1 (i n 

Rodrigues' formula: (x) = — — \x n+a e~ x ]. 

n ' n\x a e~ x dx n L J 

oo f XZ \ 

Generating function: ^ L^*' (x)z n = (1 — z~)~ a ~ x exp ( j . 

I i r l"ua+i) eX/ ^ ifz > Oanda > 0, 

Quality: L^(x)\ < j ^ _ ^ if a; > and —1 < a < 0. 

Note that a > -1 and L^ m) (a;) = (-l) m ^r • 



6.10.5 LEGENDRE POLYNOMIALS 

Symbol: P n (x). 
Interval: [—1,1]. 

Differential equation: (1 — x 2 )y" — 2xy' + n(n + l)y = 0. 

Explicit expression: P n (x) = ^- V (-l) m f f 2 ™ ~ ^V"" 2 ™. 

2 ™ m^o ^ TO ' V n / 

Recurrence relation: (n + l)P„ + i (a;) = (2n + l)xP n (x) — nP n -\(x). 
Weight: 1. 

Standardization: P n (l) = 1- 



2 2 
Aform: / [P„(x)l da; 



2n + 1 



(—1)™ 

Rodrigues' formula: P n (x) = ; ^T^ 1 _a;2 )™]- 

oo 

Generating function: P n (x)z n = (1 — 2a;2: + z 2 ) -1 / 2 , 

for -1 < a; < 1 and |z| < 1. 
Inequality: \P n (x)\ < 1 for —1 < x < 1. 

See Section 6.18.7 on page 556. 



6.10.6 CHEBYSHEV POLYNOMIALS, FIRST KIND 

Symbol: T n {x). 
Interval: [—1,1]. 

Differential equation: (1 — a; 2 )y" — xy 1 + n 2 y = 0. 

n L«/2j ( n -m-lY. 

Explicit expression: T n (x) = cos (ncos _1 a;) = - (-l) m — — — M2a;)"~ 2m 

2 ^— ' m!(n — 2m)! 

m=0 v y 
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Recurrence relation: T n+ \(x) = 2xT n (x) — T„_i(x). 
Weight: (1 -x 2 )' 1 / 2 . 
Standardization: T„(l) = 1. 

7T, n = 0, 



Norm: j (1 - a; 2 )" 1 / 2 [T„(a;)] 2 da; 



tt/2, n^O. 



Rodrtgues'fomuda: T n (x) = ( _^( n ^) £ [ (1 " " 2) "" 1/2 

CO 

Generating function: ^ T n (x)z n = -, for — 1 < x < 1 and |z| < 1. 

1 2xx ~\~ x 

n—0 

Inequality: \T n (x)\ < 1, for — 1 < x < 1. 
Note that T„(aO = rg^fj4" 1/2 '" 1/2) (a). 



6.10.7 CHEBYSHEV POLYNOMIALS, SECOND KIND 

Symbol: U n (x). 
Interval: [-1,1]. 

Differential equation: (1 — x 2 )y" — 3xy' + n(n + 2)y = 0. 

|_n/2j /_]\m/ m _ n -)| 

Explicit expression: U n (x) = > - — f—^ -f 1 (2x) n ~ 2m 

m\(n — 2m)l 

TT < a-, sin[(n + 1)6] 

U n (cos0) = — L —— '-. 

smO 

Recurrence relation: U n +\{x) = 2xU„(x) — U„-i(x). 

Weight: (l-x 2 ) 1 / 2 . 
Standardization: U n (l) = n + 1. 

Norm: [ (1 - a; 2 ) 1 / 2 [£/„(a;)] 2 da; = J. 

Generating function: } U„(x)z n = ^, for —1 < x < 1 and \z\ < 1. 

^— ' 1 — 2a;2; + 

Inequality: \U n {x)\ < n + 1, for —1 < a; < 1. 
NotethatC7„(a;) = ^fp( 1 / 2 ' 1 / 2 '(a;). 



6.10.8 TABLES OF ORTHOGONAL POLYNOMIALS 

H = 1 x 10 = (30240Ho + 75600^2 + 25200^4 + 2520i? 6 + 90H 8 + H 10 )/W24 
Hi = 2x x 9 = (15120Hi + IOO8OH3 + 1512^5 + 72H T + H 9 ) /512 

H 2 = 4x 2 - 2 x 8 = (I68OH0 + 3360H 2 + 840ff 4 + 56^6 + H a ) /256 

H 3 = 8x 3 - Ux x 7 = (840Hi + 420H3 + 42H 5 + H 7 ) /128 
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H 4 = 16a: 4 - 48a: 2 + 12 a 6 = (120PT + 180PT 2 + 30i? 4 + H 6 ) /64 

H 5 = 32a: 5 - 160a: 3 + 120a a 5 = (60i?i + 20i? 3 + H 5 ) /32 

H 6 = 64a 6 - 480a 4 + 720a 2 - 120 a 4 = (12H + 12H 2 + H 4 ) /16 

H 7 = 128a 7 - 1344a 6 + 3360a 3 - 1680a a 3 = (6-ffi + ff 3 ) /8 

Ps = 256a 8 - 3584a 6 + 13440a 4 - 13440a 2 + 1680 a 2 = (2H + H 2 )/4 

H 9 = 512a 9 - 9216a 7 + 48384a 6 - 80640a 3 + 30240a a = (Pi)/2 

Hio = 1024a 10 - 23040a 8 + 161280a 6 - 403200a 4 + 302400a 2 - 30240 1 = H 

L = l a 6 = 720L - 4320Li + 10800L 2 - 14400L 3 + IO8OOL4 - 4320L 6 + 720L 6 
Li = -x + 1 a 6 = 120Lo - 6OOL1 + 1200L 2 - 1200L 3 + 6OOL4 - 120L 6 

L 2 = (a 2 - 4a + 2) /2 a 4 = 24L - 96Li + 144L 2 - 96L 3 + 24L 4 

L 3 = (-a 3 + 9a 2 - 18a + 6) /6 a 3 = 6L - I8L1 + 18L 2 - 6L 3 

L 4 = (a 4 - 16a 3 + 72a 2 - 96a + 24) /24 a 2 = 2L - 4Li + 2L 2 

L 3 = (-a 6 + 25a 4 - 200a 3 + 600a 2 - 600a + 120) /120 a = L - Li 

L 6 = (a 6 - 36a 6 + 450a 4 - 2400a 3 + 5400a 2 - 4320a + 720) /720 1 = L 

p = 1 x 10 = (4199P + 16150P 2 + 15504P 4 + 7904P 6 + 2176P 8 + 256Pi )/46189 
Pi = a a 9 = (3315Pi + 4760P 3 + 2992P 6 + 960P 7 + 128P 9 )/12155 

P 2 = (3a 2 - 1) /2 a 8 = (715P + 2600P 2 + 2160P 4 + 832P 6 + 128P 8 )/6435 

P 3 = (5a 3 - 3a) /2 a 7 = (143Pi + 182P 3 + 88P 6 + I6P7) /429 

P 4 = (35a 4 - 30a 2 + 3) /8 a 6 = (33P + 110P 2 + 72P 4 + 16P 6 ) /231 

P 6 = (63a 6 - 70a 3 + 15a) /8 a 6 = (27 Pi + 28P 3 + 8P 6 )/63 

P 6 = (231a 6 - 315a 4 + 105a 2 - 5) /16 a 4 = (7P + 20P 2 + 8P4) /35 

P 7 = (429a 7 - 693a 3 + 315a 3 - 35a) /16 a 3 = (3Pi + 2P 3 )/5 

P 8 = (6435a 8 - 12012a 6 + 6930a 4 - 1260a 2 + 35)/128 a 2 = (P + 2P 2 )/3 

P 9 = (12155a 9 - 25740a 7 + 18018a 6 - 4620a 3 + 315a) /128 a = Pi 

P10 = (46189a 10 - 109395a 8 + 90090a 6 - 30030a 4 + 3465a 2 - 63)/256 1 = P 

To = 1 a 10 = (126T + 210T 2 + 120T 4 + 45T 6 + 10T 8 + Ti )/512 

Ti = a a 9 = (126Ti + 84T 3 + 36T 6 + 9T 7 + T 9 ) /256 

T 2 = 2a 2 - 1 a 8 = (35T + 56T 2 + 28T 4 + 8T 6 + T 8 ) /128 

T 3 = 4a 3 - 3a a 7 = (35Ti + 21T 3 + 7T 6 + T 7 ) /64 

T 4 = 8a 4 - 8a 2 + 1 a 6 = (10T + 15T 2 + 6T 4 + T 6 ) /32 

T 6 = 16a 6 - 20a 3 + 5a a 6 = (lOTi + 5T 3 + T 6 )/16 

T 6 = 32a 6 - 48a 4 + 18a 2 - 1 a 4 = (3T + 4T 2 + T 4 )/8 

T 7 = 64a 7 - 112a 6 + 56a 3 - 7a a 3 = (3Ti + T 3 )/4 

T 8 = 128a 8 - 256a 6 + 160a 4 - 32a 2 + 1 a 2 = (T + T 2 )/2 

T 9 = 256a 9 - 576a 7 + 432a 6 - 120a 3 + 9a a = Ti 

T10 = 512a 10 - 1280a 8 + 1120a 6 - 400a 4 + 50a 2 - 1 1 = To 

U = 1 a 10 = (42f/ + 90U 2 + 75U 4 + 35U 6 + 9f/ 8 + f/i )/1024 

Ui =2x a 9 = (42f7i + 48U 3 + 27U 5 + 8U7 + Ug) /512 

U 2 = 4a 2 - 1 a 8 = (UUo + 28U 2 + 20U 4 + 7U 6 + Us) /256 

U 3 = 8a 3 - 4a a 7 = (UUi + UU 3 + 6U 6 + U 7 ) /128 

U 4 = 16a 4 - 12a 2 + 1 a 6 = (5U + 9U 2 + 5U 4 + U 6 ) /64 

U 5 = 32a 6 - 32a 3 + 6a a 6 = (5Ui + 4U 3 + U 5 )/32 

U 6 = 64a 6 - 80a 4 + 24a 2 - 1 a 4 = (2U + 3U 2 + U 4 ) /16 

U 7 = 128a 7 - 192a 6 + 80a 3 - 8a a 3 = (2Ui +U 3 )/8 

Us = 256a 8 - 448a 6 + 240a 4 - 40a 2 + 1 a 2 = (U + U 2 )/4 

U 9 = 512a 9 - 1024a 7 + 672a 6 - 160a 3 + 10a a = (Ui)/2 

U10 = 1024a 10 - 2304a 8 + 1792a 6 - 560a 4 + 60a 2 - 1 1 = U 
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6.10.8.1 Table of Jacobi polynomials 

Notation: (m) n = m(m + 1) . . . (to + n — 1). 

P (a -«(*) = 1. 

P[ a ' 0) (x) = \ (2(a + 1) + (a + f3 + 2)(x - 1)) . 

P^Oe) = ^ (4(a + 1) 2 + 4(a + /? + 3)(a + 2)(a: - 1) + (a + + 3) 2 (a; - l) 2 ) . 
P^H*) = ^ (8(a + 1) 3 + 12(a + /? + 4) (a + 2) 2 (a; - 1) 

+ 6(a + /3 + 4) 2 (a + 3)(a; - l) 2 + (a + /? + 4) 3 (a; - l) 3 ) . 

P[ a ^\x) = ^ (l6(a + 1) 4 + 32(a + + 5) (a + 2) 3 (z - 1) 

+ 24(a + /3 + 5) 2 (a + 3) 2 (a; - l) 2 + 8(a + /3 + 5) 3 (a + 4) (a; - l) 3 
+ (a + /? + 5) 4 (a;-l) 4 ). 



6.10.9 ZERNIKE POLYNOMIALS 

The cz'rc/e polynomials or Zernike polynomials form a complete orthogonal set over 
the interior of the unit circle. They are given by 

U™(r,0) = R™{r)e ime (6.10.2) 

where R™(r) are radial polynomials (see below), n and to are integers with n — \m\ 
even and < \m\ < n. 



6.10.9.1 Properties 

1. Orthogonality 



[ V [ U™(r,6)U%'(r,6)rdrd6 = 5 nn , 5, 
■Jo Jo n + i 

^K(r)K l (r)rdr = ^- j S n 
2. Explicit formula for the radial polynomials 



(6.10.3) 



R± m (r) 



|m| ] \d(r 2 ) 



(r 2 )^(r 2 -l)' 



y (-iy(n-s)l ^ n _ 2s (6.10.4) 
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3. Expansions in Zernike polynomials 

(a) If f(r, 6) is a piecewise continuous function then 



oo n 



/M) = E E A nUT(r,0) where 

/ / U™(r,6)f(r,6)rdr 

n Jo Jo 



n— m— — n 

n 



Am _ a- 

(b) If f(r, 6) is a real piecewise continuous function then 

oo n 

/M) = E E [C'nCMme) + S™ S m(m6)] R™(r) 

n— m— 

where n — \m\ is even. 

2tt f 1 



n — |m| is even. 

(6.10.5) 

d6. 



£m (n + l) f f{rJ))K{r) 
n Jo Jo 



cos(to#) 
sin(m#) 



(6.10.6) 
r <ir d8 



where e r 



1 ifm = 

2 otherwise. 



6.10.9.2 Tables of Zernike polynomials 



n 


m = 


2 


4 





1 










2 


2r 2 -1 


r 2 








4 


6r 4 - 6r 2 + 1 


4r 4 - 


-3r 2 




r 4 


6 


20r 6 - 30r 4 + 12r 2 - 1 


15r 6 


- 20r 4 + 6r 2 




6r 6 - 5r 4 


8 


70r 8 - 140r 6 + 90r 4 - 20r 2 + 1 


56r 8 


- 105r 6 + 60r 4 


- 10r 2 


28r 8 - 42r 6 + 15r 4 



n 


m = 1 


3 


5 


1 


r 












3 


3r 3 - 2r 


r 3 










5 


10r 6 - 12r 3 + 3r 


5r 6 - 


- 4r 3 




r 5 




7 


35r 7 - 60r 6 + 30r 3 - 4r 


21r 7 


- 30r 6 + 10r 3 




7r 7 - 


6r 6 


9 


126r 9 - 280r 7 + 210r 6 - 60r 3 + 5r 


84r 9 


- 168r 7 + 105r 5 


- 20r 3 


36r 9 
21r 6 


-56r 7 + 



6.10.10 SPHERICAL HARMONICS 

The spherical harmonics are defined by 

YlM) = ^tollmW ^ 9 ^ (6 ' la7) 
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for I an integer and rn = —I, —I + 1, ...,/ — 1, I. They satisfy 



21 + 1 



P/(cos< 



1/r 



(!■*) 



47T 

/ (2/ + l)(/-m)!(7+" 
V 4tt 



(6.10.8) 



^ ( - 1)(,+m)/ :C: , ^integral, 



0, 



2«(i^)l(i^)l> 2 

not integral. 



The normalization and orthogonality conditions are 

f>27T /* 7T 



/ #/ sin 0d0Y l , m ,(0, ( f > )Y lm (6,<i>)= 6 W 5 mm , , (6.10.9) 

•70 JO 



and 



/•27T /*7T 

/ d<f> / si 



sin y« ima (0, ^)y /2m2 (0, ^)y /3m3 (0, 



'(2/ 2 + l) (2/ 3 + l) (h h 



47r(2/i + 1) \m 2 m 3 



«1 Ml 13 
mj \0 



(6.10.10) 



where the terms on the right hand side are Clebsch-Gordan coefficients (see page 574). 
Because of the (distributional) completeness relation, 



oo / 



E Y lm{0,4>)Ylm{0',^') = 6^-^)6(008 -cos 9'), (6.10.11) 
1=0 m=-l 

an arbitrary function g(9, <j>) can be expanded in spherical harmonics as 

oo / 

g(0,4>) = Y.Y. A imYi m (0,<f>), A lm = / Y lm {0,4>)g{0,4>) dfl. 

1=0 m=-l 

(6.10.12) 

In spherical coordinates, 

V 2 [f{r)Y lm {0,4>)} 



1 d f r2 df 



r 2 dr V dr 



1(1 + 1)^ 



Y lm {0,4>). (6.10.13) 
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6.10.10.1 Table of spherical harmonics 



/ = l 



I = 3 



Y 00 -- 

f 

Y 10 

\. 
f 

Y22 
Y21 
Y 20 

f 

Yo oZ 
Y Z2 
Yzi 
Yzv 



47T 



sintfe 



cos#. 



sm 2 0e 2i * 



io 



4tt 
1 /T5 
iV 2k 

TE 

8?r 
1 AT 
2V47 
1 |35 

IV 47T 

1 /l05 
4V 2tt 
1 [21 

4 V 47T 



^/-^(5 cos 3 0-3 cos 0). 
2 V 47r 



sinycostf e 



(3cos 2 6> - 1). 



sin 3 6 e 3i4 



sm 2 6cos6e 2i4 



sin<9(5cos 2 6>- l)e^, 



6.11 GAMMA FUNCTION 

/•OO 

r(z) = / t z ~ 1 e~ t dt, z = x + iy, x > 0. 



6.11.1 RECURSION FORMULA 

r(z + 1) = zT(z). 

The relation T(z) = T(z + 1) jz can be used to extend the gamma function to the left 
half plane for all z except when z is a non-positive integer (i.e., z ^ 0, —1, —2, . . .). 
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FIGURE 6.6 

Graphs ofT(x) and 1/T(x) for x real. (From Temme, N. M., Special Functions: An Intro- 
duction to the Classical Functions of Mathematical Physics, John Wiley & Sons, New York, 
1996. With permission.) 




6.1 1 .2 GAMMA FUNCTION OF SPECIAL VALUES 

r(n + l) =n\ ifn = 0,l,2,...,where0! = 1, 

r(i) = i, r(2) = i, r(3) = 2, r(i) = V^, 

( 1\ l-3-5---(2m-l) ,- 
T\m + -j= ^ m = l,2,3,..., 

/ -j\ (_l)ni2m 



r (i) = 3.62560 99082, 

r (I) = v^F= 1.77245 38509, 

r (|) = 1.2254167024, 



r (i) = 2.67893 85347, 
r (|) = 1.3541179394, 
r (|) = v^F/2 = 0.88622 69254. 



6.11.3 PROPERTIES 

1. Singular points: 

The gamma function has simple poles at z = —n (for n = 0, 1, 2, . . .), with 
the respective residues (— l) n /n\; that is, 

f-l)» 

Urn (z + n)T(z) = ^-f-. 
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2. Definition by products: 

T(z) = lim 
1 



n\ n 



n-s-oo z(z + 1) • • • (z + n) ' 

pr = z e yz J [ ^(1 + z/n) e _z /"J , 7 is Euler's constant. 



3. Other integrals: 



r(2;) cos— = / t z ~ x costdt, 0<Rez<l, 
2 J 



T(z) sin y = / sinidi, -KReKl. 



f CO 



4. Derivative at x = 1: 

T'(l) = /" lnie _t di = -7 

5. Multiplication formula: 

r(2z) = tt" 1 / 2 2 22 " 1 r(z) r ^ + ^ . 

6. Reflection formulae: 

r(z)r(i-z) = ^^, 

sin TTZ 

r(i + z)r(i-z) = -^, 

w ' w ' COS 7T2: 

r(i-z) (-i) n 7r 



r(z -n) = (-i) n r(z) 



r(n + 1 — z) sirniz r(n + 1 — 2) 



6.11.4 ASYMPTOTIC EXPANSION 

For z — > 00, I argzl < 7r: 



r(z) ~ J— z z e 



ln r(2;) ~ In 



In 



139 



12 z 288 z 2 51 840 z 3 

OO 



+ 



z 

2^ 



B 



2n 



1 



^ 2n (2n - 1) z 

n—l v ' 



1n-\ 



(6.11.1) 



1 



1 



+ 



1 



1 



12z 360z 3 1260z 5 1680z 7 



+ . 



where B n are the Bernoulli numbers. If we let z = n a large positive integer, then a 
useful approximation for n\ is given by Stirling's formula, 



r(n + 1) = nl ~ \f2i:nn n e n , «->oo. 



(6.11.2) 
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6.1 1 .5 LOGARITHMIC DERIVATIVE OF THE GAMMA FUNCTION 

1. Definition: 

♦W = 5 b,rw = - T + 5: — -— ■ ^0,-1,-2,.... 

2. Special values: 

V>(l) = -7, V(^) ="7-21n2. 

3. Asymptotic expansion: 

For z — > oo, I arezl < tt: 



ip{z) ~ lnz - ^- - ^ 



OO R 



2z ^ 2n^ 2n 

1 1 1 1 

~ n ^~2l"l2^2 + 120^" 252^6 + 



6.11.6 NUMERICAL VALUES 



X 


r(a;) 


lnr(x) 


4>{x) 




1 


00 


1 


00000000 





00000000 


-0 


57721566 


1 


64493407 


1 


04 





97843820 


-0 


02179765 


-0 


51327488 


1 


55371164 


1 


08 





95972531 


-0 


04110817 


-0 


45279934 


1 


47145216 


1 


12 





94359019 


-0 


05806333 


-0 


39545533 


1 


39695222 


1 


16 





92980307 


-0 


07278247 


-0 


34095315 


1 


32920818 


1 


20 





91816874 


-0 


08537409 


-0 


28903990 


1 


26737721 


1 


24 





90852106 


-0 


09593721 


-0 


23949368 


1 


21074707 


1 


28 





90071848 


-0 


10456253 


-0 


19211890 


1 


15871230 


1 


32 





89464046 


-0 


11133336 


-0 


14674236 


1 


11075532 


1 


36 





89018453 


-0 


11632650 


-0 


10321006 


1 


06643142 


1 


40 





88726382 


-0 


11961291 


-0 


06138454 


1 


02535659 


1 


44 





88580506 


-0 


12125837 


-0 


02114267 





98719773 


1 


48 





88574696 


-0 


12132396 





01762627 





95166466 


1 


52 





88703878 


-0 


11986657 





05502211 





91850353 


1 


56 





88963920 


-0 


11693929 





09113519 





88749142 


1 


60 





89351535 


-0 


11259177 





12604745 





85843189 


1 


64 





89864203 


-0 


10687051 





15983345 





83115118 


1 


68 





90500103 


-0 


09981920 





19256120 





80549511 


1 


72 





91258058 


-0 


09147889 





22429289 





78132645 
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X 


T(x) 


lnr(x) 


tjj{x) 


i>'(x) 


1.76 


0.92137488 


-0.08188828 


0.25508551 


0.75852269 


1.80 


0.93138377 


-0.07108387 


0.28499143 


0.73697414 


1.84 


0.94261236 


-0.05910015 


0.31405886 


0.71658233 


1.88 


0.95507085 


-0.04596975 


0.34233226 


0.69725865 


1.92 


0.96877431 


-0.03172361 


0.36985272 


0.67892313 


1.96 


0.98374254 


-0.01639106 


0.39665832 


0.66150345 


2.00 


1.00000000 


0.00000000 


0.42278434 


0.64493407 



6.12 BETA FUNCTION 

B(p,q)=f t p ~ l (l -t)"- 1 dt, Rep>0, Re q > 0. (6.12.1) 
Jo 



B{p, q + 1) = ^ B (p + 1, q) = B(p, q), 

p p + q 



1. Relations: 

B(p,q)=B(q,p), 

> 

r> i \ -rii I x r(p) r( g ) r(r) 

B( P , g )B( P + g ,r)= r(p + g + r) ■ 

2. Relation with the gamma function: 

r(p)r(g) 



r(p + 



3. Other integrals (in all cases Re p > and Re q > 0): 

r*7 2 



B(p, q)=2 sin 22 '- 1 6> cos 2 "" 1 d0 
Jo 



t v ~ l 

■dt 



o (t + 

rOQ 

/ e-* (I - e-*)"- 1 dt 
Jo 

r«(r + If / / . X r > 0. 
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6.12.1 NUMERICAL VALUES OF THE BETA FUNCTION 



p 


g = U.1UU 


n onn 
U.2UU 


U. JUU 


n a nn 
U.4UU 


n ^nn 
U.5UU 


n Ann 
U.6UU 


U. /UU 


n onn 
U.oUU 


n nnn 

u.yuu 


i nnn 
l.UUU 


0.1 


19.715 


14.599 


12.831 


1 1.906 


11.323 


10.914 


10.607 


10.365 


i n i aa 

10.166 


10.000 


0.2 


14.599 


9.502 


7.748 


6.838 


6.269 


5.872 


5.576 


5.345 


5.157 


5.000 


0.3 


12.831 


7.748 


6.010 


C 1 1 1 

5.112 


A C C A 

4.554 


a 1 An 

4.169 


3.883 


n A A 1 

3.661 


3.482 


i.iii 


0.4 


11.906 


6.838 


5.1 12 


4.226 


3.679 


3.303 


3.027 


2.813 


2.641 


2.500 


0.5 


11.323 


6.269 


4.554 


3.679 


3.142 


2.775 


2.506 


2.299 


2.135 


2.000 


0.6 


in (11 i 

10.914 


5.872 


a 1 An 

4.169 


3.303 


2.775 


2.415 


O 1 C A 

2.154 


i nc a 

1.954 


1 TnA 

1.796 


1 A AT 

1.667 


0.7 


10.607 


5.576 


3.883 


3.027 


2.506 


2.154 


1.899 


1.705 


1.552 


1.429 


0.8 


10.365 


5.345 


3.661 


2.813 


2.299 


1.954 


1.705 


1.517 


1.369 


1.250 


0.9 


10.166 


5.157 


3.482 


2.64 1 


2.135 


1.796 


1.552 


1.369 


1.226 


1.111 


1.0 


10.000 


5.000 


3.333 


2.500 


2.000 


1 A AT 

1.667 


1.429 


1.250 


1.111 


1.000 


1.2 


9. /33 


A 7C 1 

4. /51 


i nnn 
3.U99 


2.2 ly 


i./yi 


1 A AO 

1.465 


1 OQn 


1.U69 


n mo 
0.935 


0.533 


1.4 


9.525 


4.559 


2.921 


2.1 13 


1.635 


1.321 


1.101 


0.938 


0.813 


0.714 


1 6 




d dC\d 


? 77Q 


1 08? 


1 ^ 1 ^ 

i.jij 


1 ?f)8 

1 . AUO 


f) QQ4. 

U.77t 


U.OJ / 


n 71 s 


U.UA J 


1.8 


9.213 


4.276 


2.663 


1.875 


1.415 


1.117 


0.909 


0.758 


0.644 


0.556 


2.0 


9.091 


4.167 


2.564 


1.786 


1.333 


1.042 


0.840 


0.694 


0.585 


0.500 


2.2 


8.984 


4.072 


2.480 


1.710 


1.264 


0.979 


0.783 


0.641 


0.536 


0.455 


2.4 


8.890 


3.989 


2.406 


1.644 


1.205 


0.925 


0.734 


0.597 


0.495 


0.417 


2.6 


8.805 


3.915 


2.340 


1.586 


1.153 


0.878 


0.692 


0.558 


0.460 


0.385 


2.8 


8.728 


3.848 


2.282 


1.534 


1.107 


0.837 


0.655 


0.525 


0.430 


0.357 


3.0 


8.658 


3.788 


2.230 


1.488 


1.067 


0.801 


0.622 


0.496 


0.403 


0.333 



6.13 ERROR FUNCTIONS 



2 r _,2 

erf a; = — f= / e eft, 

v 7r .7o 



— / 



erfca; = — = e dt 



oo 

i 2 



The function erf a; is known as the error function. The function erfca; is known as 
the complementary error function. 



6.13.1 PROPERTIES 

1. Relationships: 

erf x + erfc x = 1 , erf (—a;) = — erf x, erfc(— x) = 2 — erfca;. 

2. Relationship with normal probability function: 
— = / e -2* d f = erf 
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6.13.2 ERROR FUNCTION OF SPECIAL VALUES 

erf(±oo) = ±1, erfc(— oo) = 2, erfcoo = 0, 

erf xq = erfc xq = ^ if xq £s 0.476936. 



6.13.3 EXPANSIONS 

1. Series expansions: 

V5F ^ (2n + 1) n! ~ V5F r 3 + 2! 5 3! 7 + 

= 4= e e ~ 3 f * 2n+i = 4 e_a;2 ^ + ^ 3 + • • ■) 

A^ o r(n + |) A V 3 15 J 

2. Asymptotic expansion: 

For z — > oo, | &rgz\ < jTr, 

f 2 e- 2 " (-l)"(2n)! 

V^F 2z 2^ n \(2z)^ 

2 e" 2 ' / 1 3 15 

l-^r + ^-r-^ + . 



0r 2z \ 2z 2 4z 4 8z 6 



6.13.4 SPECIAL CASES 

1. Dawson's integral 



2 /"^ 2 1 2 

F(x) = e -31 / e* dt = --i^/ir e~ x erf(ix). 



2. Plasma dispersion function 



= e z erfc(— 12;) 
e 



di, Im z > 



2e _z -w(-z) 

i r W2+i)' 
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FIGURE 6.7 

Cornu's spiral, formed from Fresne I functions, is the set {x, y, t} where x = C(t), y = S(t), 
t > 0. (From Temme, N. M., Special Functions: An Introduction to the Classical Functions 
of Mathematical Physics, John Wiley & Sons, New York, 1996. With permission.) 



(0.5,0.5) 




6.14 FRESNEL INTEGRALS 

C{z) = ^ J cost 2 dt, S{z) = ^ J sini 2 dt. 

6.14.1 PROPERTIES 

1. Relations: 

C(z) + iS(z) = erf . 

2. Limits: 

lim C(z) = \, lim S(z) = \. 



3. Representations: 



C{z) = \ + f{z) sm(z 2 )-g(z) cos(z 2 ), 
S(z) = \-f(z) co S (z 2 )-g(z) S m(z 2 ), 



where 



00 Vte~ z * 



1 f°° e~ z2t 1 f 

4. Cornu's spiral: 

fK poo 

^-J e it2 dt=[g(z)+if(. 



dt. 



[z e" 
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6.14.2 ASYMPTOTIC EXPANSION 

And for z — > oo, |arg;z| < ^tt, 

i g ( _ ir r (aB + i/2)_ i 



/(*) 



TTV^ 



n=0 
oo 



TTi/2 



n=0 



-,2n+l/2 

„r (2n + 3/2) 

z 2n+3/2 



V2TTZ 
1 

2zV^kz 



3 105 
~ 4^2 + 16 



15 945 
~ 4^2 + 16 



6.14.3 NUMERICAL VALUES OF ERROR FUNCTIONS AND 
FRESNEL INTEGRALS 
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FIGURE 6.8 

Sine and cosine integrals Si(x) and Ci(x), for < x < 8. (From Temme, N. M., Special 
Functions: An Introduction to the Classical Functions of Mathematical Physics, John Wiley 
& Sons, New York, 1996. With permission.) 




6.15 SINE, COSINE, AND EXPONENTIAL 
INTEGRALS 

6.15.1 SINE AND COSINE INTEGRALS 

cos t — 1 



. f z sini , . , f z 

Si(z) = / dt, Ci(z) = 7 + lnz + / 



where 7 is Euler's constant. 
1. Alternative definitions: 



dt, 



Si(z) = \*-J~^dt, Ci(z) = -£ 



cosi , 
eft. 



2. Limits: 



3. Representations: 



lim Si(z) = 1-tt, lim Ci(z) = 0. 

z— foo 2 2— foo 



Si(z) = —f{z) cos 2; — sin z + ^ 7r, 



Ci(z) = sin z — g(z) cos z, 

where 



00 + „-zi 



/■°° e , , , r te" 

/w=y o ^y*. «w=y o ^y*. 
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4. Asymptotic expansion: 

For z — > oo, I arg z\ < tt, 



, w ~Af;(-i).<*' +1 " 



7 2n 



n=0 



n=0 



6.15.2 EXPONENTIAL INTEGRALS 

poo — zt 



roo -zi 

«.(')=/ - 



dt, Rez>0, n = l,2,. 



n-1 -z -oo -ztjn-1 

/ — dt, Re z > 0. 

Jo t + 1 



1. Special case: 



For real values of z = x, 



r(n) 

J z 

Ei(x) = ^ 



di, I arg 2; I < 7r. 



■eft, 



where for a; > the integral should be interpreted as a Cauchy principal value 
integral. 



2. Representations: 

Ei (z) = —7 — In z + 

E x (ze*™) = -7 - In z - Ci(z) + i 
Ei(x) = -Ei(-x), x > 



I- 

Jo 



t 



■dt, 



--7T + Si(z) 



6.15.3 LOGARITHMIC INTEGRAL 

dt 



li(x) = f 
Jo 



In* 



Ei(ln x), 



where for x > 1 the integral should be interpreted as a Cauchy principal value 
integral. 
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6.15.4 NUMERICAL VALUES 
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6.16 POLYLOGARITHMS 



f z dt 

Lii(z) = / = — ln(l — z), logarithm, 

. > f z Li x (t) , f z ln(l -t) , ,., 

Li 2 (z)= / -^-!-dt = - — -dt, dilogarithm, 

Jo t Jo t 



f z Li (t) 

Li„(2;) = / — — dt, n>2, polylogarithm, 

Jot 

z f°° t v ~ l 

lA v (z) = — — / — dt, Re v > 0, z 4. {Re z £ [1, ool,Imz = 0} . 

I (") Jo ' ' 
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6.16.1 POLYLOGARITHMS OF SPECIAL VALUES 

t- m t ( n ^ t m ( ln2 ) 2 

Li 2 (l) = -, Li 2 (-1) = --, Li 2 (,) = --^-. 

Li„(l) = ((v), Re v > 1 (Riemann zeta function). 



6.16.2 POLYLOGARITHM PROPERTIES 

1 . Definition: For any complex v 

OO 

2. Singular points: 

z = 1 is a singular point of Li„ (2;). 

3. Generating function: 

00 ^ (-00 giui _ 

E w ™ _1 Li„(z) = z / — dt, z£[l,oo). 

n=2 Jo e Z 

The series converges for |w| < 1; the integral is defined for Re w < 1. 

4. Functional equations for dilogarithms: 

Li 2 (z) +Li 2 (l - z) = Itt 2 - Inz ln(l - z), 



- Li 2 (a; 2 ) = Li 2 (x) + Li 2 (-x), 

Li 2 (-l/a:) +Li 2 (-a:) = -^tt 2 - ± (In a;) 2 , 

2Li 2 (a;) + 2Li 2 (y) + 2Li 2 (z) = 

Li 2 (-xy/z) + Li 2 (-yz/x) + lA 2 (-zx/y), 

where 1/x + 1/y + 1/z = 1. 



6.17 HYPERGEOMETRIC FUNCTIONS 

Recall the geometric series and binomial expansion (\z\ < 1), 

OO OO s v OO 

(i - = y, a (i - *r a = E ( D (-*)" = E 



(°)n ..« 
_ i z i 



© 2003 by CRC Press LLC 



where the shifted factorial, (a) n , is defined in Section 1.2.6. 
The Gauss hypergeometric function, F, is defined by: 



n=0 



1 ab a(a + 1)6(6+1) 2 . . , (6.17.1) 

= 1 + ~ Z+ C(C + 1)2I V + N<1 ' 
= F (6, a; c; z) 

where a, 6 and c may all assume complex values, c ^ 0, —1, —2, .... 



6.17.1 SPECIAL CASES 

1. F{a,b;b;z) = (1 - z)" a 

2. F(l,l;2;,) = -Mi^ 

3. /(',:^ ± „/ ' 



2' '2' / 2z 

4. F|'i,l;|-^ tan "^ 

5. Flli;?;,^ ^ Z 



2'2'2' I z 



113 2 \ ln(z + VI + z 2 ) 



6. F --■-■-z 



2' 2' 2' " J z 
7. Polynomial case; for m = 0, 1, 2, . . . 

F {-m, 6; c; z) = £ t^h^ z « = M z - (6 . 17 .2) 



6.17.2 PROPERTIES 

1. Derivatives: 

^-F{a, 6; c; z) = — F(a + 1, 6 + 1; c + 1; z), 

az c 

— F(a, 6; c; z) = — — F(a + n, 6 + n; c + n; z). 

CtZ v c Jn 

2. Special values; when Re (c — a — 6) > 0: 

r( c )r( c - a - 6) 

F(a, 6; c; 1) = — — -. 

T(c — a)T(c — 6) 

3. Integral; when Re c > Re 6 > 0: 

^ &; c; *> = rx6)^6) r ^ - - ^ *■ 
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4. Functional relationships: 

F(a,b;c; z) = (1 - z)~ a F(a,c- b; c; 

= (l-z)- b F(c-a,b;c;-?-) 
v z — 1' 



z 

z ■ 

\c—a — b i 



= (1 - ^) c - a -"F(c - a, c - b; c; z). 

5. Differential equation: 

z(l - z)F" + [c-(a + b+ l)z]F' - abF = 0, 
with (regular) singular points z = 0, 1, oo. 



6.17.3 RECURSION FORMULAE 

Notation: F is F (a, 6; c; 2); F(a+), F(a-) are F (a + 1, 6; c; z) , 
F (a — 1, 6; c; z), respectively, etc. 

1. (c - a)F(a-) + (2a -c-az + bz)F + a(z - l)F(a+) = 

2. c(c-l)(z-l)F(c-)+c[c-l-(2c-a-6-l)z]F+(c-a)(c-6)zF(c+) = 

3. c[a + (b- c)z]F - ac(l - z)F(a+) + (c - a)(c - b)zF(c+) = 

4. c(l - z)F - cF(a-) + (c - 6)zF(c+) =0 

5. (b - a)F + aF(a+) - bF(b+) = 

6. (c - a - 6)F + a(l - z)F(a+) - (c - 6)F(6-) = 

7. (c - a - 1)F + aF(a+) - (c - l)F(c-) = 

8. (6 - a)(l - z)F - (c - a)F(a-) + (c - b)F(b-) = 

9. [a - 1 + (b + 1 - c)z]F + (c - a)F(a-) - (c - 1)(1 - z)F(c-) = 



6.18 LEGENDRE FUNCTIONS 



6.18.1 DIFFERENTIAL EQUATION: LEGENDRE FUNCTION 

The Legendre differential equation is, 

(1 - z 2 )w" - 2zw' + v{v + l)w = 0. 

The solutions P v (z),Q v (z) can be given in terms of Gaussian hypergeometric 
functions. 
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FIGURE 6.9 

Legendre functions P n (x), n = 1, 2, 3 (left) and Q n (x), n = 0, 1, 2, 3 (right) on the interval 
[— 1, 1]. (From Temme, N. M., Special Functions: An Introduction to the Classical Functions 
of Mathematical Physics, John Wiley & Sons, New York, 1996. With permission.) 





6.18.2 DEFINITION 



P II (Z)=F[ - V , V +l;l;i-i Z 



Q v {z) 



r>+f) (2z) 

The Q„ function is not denned if v = — 1, —2, 



V? I> + 1) , ^ , i o _ 2 



6.18.3 SINGULAR POINTS 

i^(z) has a singular point at z = —1 and is analytic in the remaining part of the 
complex plane, with a branch cut along (— oo, —1]. Q v (z) has singular points at 
z = ±1 and is analytic in the remaining part of the complex z— plane, with a branch 
cut along (—oo, +1]. 



6.18.4 RELATIONSHIPS 

P-u-l(z) ■■ 

Q-„-i(z) 



PA"), 

- QA Z ) cot vt:P v (z) . 
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6.18.5 RECURSION RELATIONSHIPS 

(y + l)P v+1 (z) = (2i/ + l)zP v {z) - vP v -i{z), 
{2 V +l)P v {z)=Pl + M-K-^), 
( V +l)P v (z)=P' v+l (z)-zPl(z), 

vP v (z)=zP' v (z)-P' v _ 1 (z), 
(1 - z 2 )P' v {z) = vPv-M - vzP v (z). 

The functions Q v (z) satisfy the same relations. 



6.18.6 INTEGRALS 

2 ( a cosh(z/ + \)0 
P v {cosha) = - / . 2J d0 

7T J v 2 cosh a — 2 cosh 8 

-(„+l/2)fl 



i r 

7T 7_ a V2 cosh a — 2 cosh # 

i r (hp 

7T 7 (cosh a + sinha cosipy +1 

i r 

— / (cosh a + sinha cosip) v dtp. 
n Jo 



(6.18.1) 



^ cos(i/ + \)0 
V2 cos# - 2cos/? 



P„(cos 13) = - I — "V ■ 2^ = d6 , 

» ./() " ' ' " ' 



1 r 
7 



(6.18.2) 



(cos P + i sin pj cos 

= — f (cos p) + ism p) cos tpy dtp. 
* Jo 

Q v (z) = 2- v ~ x J ^ ^IP+i dt Rei/> _1 ' |arg ^ <7r ' z * 

= y |z + \/z 2 — 1 cosh <^J d(/> 

r°c e _( y+ i/ 2 )e (6.18.3) 
= / = d9, z = cosh a. 

J a v2cosh# — 2 cosh a 

6.18.7 POLYNOMIAL CASE 

Legendre polynomials are special cases (see Section 6.10.5) when v = n = 0, 1, . . . , 
P n (x)=F[-n,n + l;l;]--^) (6.18.4) 



On 



2 2, 

(-l) fc (2n-2fc)! „_ 2i; _Jl n > if n even, 



-X , m 



i=Q 2-k\(n-k)\(n-2k)\ ' U(n - 1), if n odd. 
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The Legendre polynomials satisfy / P n ( x)Pm(x) dx — — ■ —S nm . 

J_i 2m + 1 

The Legendre series representation is 

00 2r> 4- 1 f 1 

f(x) = J2 A nPn(x), A n = — — / f(x)P n (x)dx. (6.18.5) 

For integer order, we distinguish two cases: Q n (x) (defined for x € (—1, 1)) 
and Q n (z) (defined for Re z ^ [-1, 1]): 

Qo(z) = J Q 1 (x) = \x\n\±^ - I, (6.18.6) 

2 1 — x 2 1 — x 

and 

g (z) = ^lnj^|, Qi(z) = ^zlnJ±j-l. (6.18.7) 
In both cases 

O-ftr) = «.(.)«.(») - £ ' „, + t " + !)'„, W «>' 8 - 8 > 



Legendre polynomials P n (x) and functions Q„(a;), a; € (—1, 1). 



n 




Qn(x) 



1 

2 
3 
4 
5 


1 

a; 

I(3a; 2 -1) 

1 (35a; 4 - 30a; 2 + 3) 
I x(Q3x 4 - 70a; 2 + 15) 


iln[(l + a;)/(l-a;)] 
Pi(a;)Qo(a;)-l 
P2(x)Q (x) -\x 
P 3 (x)Q (x) - % x 2 + | 
P 4 (a;)Qo(a;) - f a; 3 + ffa; 
iMz)Qo(*)-f a; 4 + f a; 2 -^ 



6.18.8 DIFFERENTIAL EQUATION: ASSOCIATED LEGENDRE 
FUNCTION 

The associated Legendre differential equation is 



(1 - z 2 )y" - 2zy' + 



1-z 2 



y = 0. 



The solutions P^(z),Q^(z), the associated Legendre functions, can be given in 
terms of Gauss hypergeometric functions. We only consider integer values of ji, v, 
and replace them with m,n, respectively. Then the associated differential equation 
follows from the Legendre differential equation after it has been differentiated m 
times. 
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6.18.9 RELATIONSHIPS BETWEEN THE ASSOCIATED AND 
ORDINARY LEGENDRE FUNCTIONS 

The following relationships are for z $ [—1, 1] 



P™(z) = (z'-l)^ m — P n (z) 



Pn m (z) 



dz r 



2 n n\ 
(n — to) ! 
(n + to) ! 



(z 2 ~ 1) 



(* 2 " 1)", 



g™(z) = (z i -i)' m T -g„(z), 



(n — to)! 



(n + to) ! 

P~ m (z) = (Z 2 - l)"* m f--f Pn(t) (dzY 



POO POO 

Q- m (*) = (-i) m (* 2 -i)-* m / •••/ g„W(dz) m , 

■/ 2 J Z 
y v ' 

m 

J 3 ™_iW=P„ m (z). 



6.18.10 ORTHOGONALITY RELATIONSHIP 

Let n>m, then 



P™(x)P^(x)dx= { 



0, 



2 (n + m)! 



2n + 1 (n - to)! ' 



if fc ^ n, 
if fc = n. 



6.18.11 RECURSION RELATIONSHIPS 



2mz 



= (n-TO+^^ + TO)^™- 1 ^) 



(z 2 - 1) n ^ Z) = mzP™(z) + Vz 2 -lP™ +1 (z), 

(2n + l)zP™(z) = (n - rn + l)P™ +1 (z) + (n + m)P^_ 1 (z), 

r ]pm( 7 \ 

{Z ' 2 ~ l) ^d^ = ( n - m+1 ) p n + i(z) ~ (n + l)zP?(z), 
CiW - Pn+i(z) = "(2n + \)Jz^\P™-\z). 
The functions Q™{z) satisfy the same relations. 



© 2003 by CRC Press LLC 



6.19 BESSEL FUNCTIONS 



6.19.1 DIFFERENTIAL EQUATION 

The Bessel differential equation is 

z 2 y" +zy' + (z 2 - v 2 )y = 0. 
The solutions are denoted with 

J v (z), Y v {z) (the ordinary Bessel functions) 

and 

H ( V (z) , H ( V (z) (the Hankel functions). 
Further solutions are 

Y_ v (z), H^(z), H i2) v (z). 



When v is an integer, 



J- n (z) = (-l) n J n (z), n = 0,1,2, 















/ 'A 1 


V\l 1 \ / 1 






\ S /\ / 




to; / \ 







Bessel functions Jo (a;), Ji(a;), lo(aO, 5"i(a0, < x < 12. 



6.19.2 SINGULAR POINTS 

The Bessel differential equation has a regular singularity at z = and an irregular 
singularity at z = oo. 
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6.19.3 RELATIONSHIPS 

HW{z) = J„{z)+iY„{z), Hl 2 \z) = J v {z)-iY v {z). 
Neumann function: If v ^ 0, ±1, ±2, . . . 

COSI/7T J v (z) — J- V {z) 



sin vtt 



When v = n (integer) then the limit v — > n should be taken in the right-hand side of 
this equation. Complete solutions to Bessel's equation may be written as 

c\J v {z) + C2J-„(z), if v is not an integer, 

ci J v (z) + C2Y v {z), for any value of v, 

dH^(z) +c 2 hW(z), for any value of v. 



6.19.4 SERIES EXPANSIONS 

For any complex z, 



J v {z) 

Mz) 

Y n (z) 



n=0 



T(n + v + l)nV 



1 - ( ^ )2+ 2!2! ( ^ )4 -3!3! ( ^ )6 + 

1 /I nO 1 /I \ A 1 



1 



r 



2 , {\z)- nn ^{n-k-l)\ n 



1!2! V2 
-J„(z)In(Iz) V! 



7T 

(\zY 



E 

i:=0 



fc! 



(H 



2k 



00 f-ll^fi z) 2 * 

»< i + 1 » + *" + l + 1 »TiW^ 

k=0 v y 



where ^ is the logarithmic derivative of the gamma function. 



6.19.5 RECURRENCE RELATIONSHIPS 

C v - 1 (z)+C v+1 (z) = —C v (z), 

z 

C v - 1 (z)-C v+1 (z)=2C' v (z), 

C' v (z)=C v - 1 (z)--C v (z), 

z 

Cl(z) = -C v+1 (z) + ^C v (z), 
where C v (z) denotes one of the functions J v {z), Y v {z), (z), (z). 
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6.19.6 BEHAVIOR AS z 

Let Re v > 0, then 

J ^)~FTT7v r(i/)(-), 

7ri \ z y 7ri \ z y 

The same relations hold as Re v — > oo, with z fixed. 



6.19.7 INTEGRALS 

Let Re z > and i/ be any complex number. 

-vt — z sinh t ^ 



J v (z) = — f cos(i/# — z sin 6) d6 — ^ ^ [ 
n Jo k Jo 

= ^_ t- / (l — t 2 Y 2 cos ztdt, Re v > — i z complex, z ^ 0, 

v^i> + ±) y_ 1 v y 2> 

2 (^) _!y Z" 00 sin art , „ . , , 

= _1 2 ,/ r/ -rdt, a:>0, Rei/ <-± 

^(i-^A ( t 2 _ 

y„(z) = - / sin(zsin6> - vO) d6 - (e vt + e~ vt cosi/tt) e " zsinhi dt 
n Jo Jo 

2{\x)~ v f°° cosxt , „ , i 

When i/ = n (an integer), the second integral in the first relation disappears. 



6.19.8 FOURIER EXPANSION 

For any complex z, 

oo 

e - izsi „ i= J- e- int J n (z), 

n— — oo 

with Parseval relation 

oo 



6.19.9 AUXILIARY FUNCTIONS 

Let x = z — (\v + j)ir and define 

P{v,z) = \Zttz~/2[ J v (z) cos x + Y v (z) sin x], 
Q{v, z) = y / irz/2[-J v (z) sinx + Y v (z) cosx]- 
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6.19.10 INVERSE RELATIONSHIPS 

J v {z) = V2/M [P(v,z) cos X - Q(v, z) sinx], 
Y v {z) = y/2/(irz) [P(y,z) sm X + Q(v,z) cos*]. 

For the Hankel functions, 

HW(z) = j2j(^z)[P{ V ,z)+iQ{ V ,z)}e i *, 
(z) = y^/i^) [P{v, z) - iQ{v, z)]e-^. 

The functions P(v, z),Q(v, z) are the slowly varying components in the asymptotic 
expansions of the oscillatory Bessel and Hankel functions. 



6.19.11 ASYMPTOTIC EXPANSIONS 

Let (a, n) be defined by 



(a,n) 



-{(4a J - l)(4a 2 - 3 2 ) • • • (4a 2 - (2n - l) 2 )} 
n! 

r(i + a + n) 



i!r(i + a-n)' 



n = 0,1,2 



, j. j . . . , 



(-1)™ costal . 

-r(| +a + n)r(i -a + n), 



7rn! 



with recursion 

(a, n + 1) = 
Then, for z — > oo, 



(n + |) 2 - a 2 
n + 1 



(a, n), n = 1,2,3,..., (a,0) = l. 



n=0 



n=0 



(2^) 2 



With /i = 4z^ 2 , 



fc- 1)^-9) (/x-l)(/x- 9)(/x- 25)(/x- 49) 

2!(8,) 2 + W 

/i-1 (^-1)^-9)^-25) , 
Q\y,z) ~ — -, — NO h 



8z 3! (8z) 2 

For large positive values of x, 

J v {x) = y/2/(irx) 
Y v (x) = 



C0S(X — — VK — — 7r) + 0(x 1 ) 

2 4 

sin(a; — - vtt — — tt) + 0(x~ x ) 
2 4 



© 2003 by CRC Press LLC 



6.19.12 ZEROS OF BESSEL FUNCTIONS 



For v > 0, the zeros j Vt k (and y Vy k) of J v (x) (and Y v {x)) can be arranged as se- 
quences 

< < ji/,2 < • • • < j v ,„ < • • • , lim j v n = oo, 

n— foo 

< y v ,i < y v ,2 <■■■ < y„, n < ■■■ , lim y v , n = oo. 

n— foo 

Between two consecutive positive zeros of J v (x) , there is exactly one zero of J„+i (x) 
Conversely, between two consecutive positive zeros of J v +i (x), there is exactly one 
zero of J v {x). The same holds for the zeros of Y v {z). Moreover, between each 
pair of consecutive positive zeros of J v {x), there is exactly one zero of Y v {x), and 
conversely. 



6.1 9.1 2.1 Asymptotic expansions of the zeros 

When v is fixed, s ~3> v, and [i = 4i/ 2 , 



3v,s 

where a 

(s + \v - 



fi-1 

8a 



1 



4(7/x 2 - 31) 32(83/i 2 - 982// + 3779) 



3(8a) 2 



15(8a) 4 



+ . 



(s + \v — i)7r; y v<s has the same asymptotic expansion with a 



n 


jo,n 


jl,n 


V0,n 


2/1, n 


1 


2.40483 


3.83171 


0.89358 


2.19714 


2 


5.52008 


7.01559 


3.95768 


5.42968 


3 


8.65373 


10.17347 


7.08605 


8.59601 


4 


11.79153 


13.32369 


10.22235 


11.74915 


5 


14.93092 


16.47063 


13.36110 


14.89744 


6 


18.07106 


19.61586 


16.50092 


18.04340 


7 


21.21164 


22.76008 


19.64131 


21.18807 



Positive zeros j„ >n , of Bessel functions J„ (x) , Y v (x) , v = 0, 1. 



6.19.13 HALF ORDER BESSEL FUNCTIONS 

For integer values of n, let 

j n (z) = y/jr/(2z)J n+ i(z), y n (z) = y/n/(2z)Y n+i (z). 

Then 



j (z) = y-i(z) 
and, for n = 0, 1, 2, . . ., 



> !/oW = -i-iW 



cos z 



j„(z) = (-z) n 



z dz 



smz 



, Vn{z) = -(-z)' 



'Id/ 

z dz 



cosz 
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6.19.13.1 Recursion relationships 

The functions j n (z) , y n (z) both satisfy 

z[/„_i(z) + fn+i (z)} = (2n + l)/„(z), 
n/„_i(z) - (n + l)/ n+ i(z) = (2n + 1)/^). 

6.19.13.2 Differential equation 

z 2 /"+2z/' + [z 2 -n( n + l)]/ = 0. 



6.19.14 MODIFIED BESSEL FUNCTIONS 

1. Differential equation 

2 II , / / 2 . 2\ n 

z y + — + i/ jy = 

2. Solutions J„(z), K v {z), 



(2/2) 



2n 



n=0 



r(n + i/+ l)n!' 



. 7..M-I.W 

2 sin i/7T 

where the right-hand side should be determined by 1' Hospital's rule when v 
assumes integer values. When n = 0, 1, 2, . . ., 

*„(*) =(-D" +1 /nW In J + V E ( " " " " ( 



2 2\z 



k=0 



+ (_1)» ^ n + 1} + + fc + 1}] 



(z/2) 



2k 



k=0 



k\ {n + k)\ 



3. Relations with the ordinary Bessel functions 



I v {z) =e-^ vni J v {ze^ 
I v {z) = ei vni J v {ze-i ni ^j 



7T . I, 



K v {z) = -^ie-*™!!™ (ze-T") 
Y v (ze^ = e^+^hiz) - X(z) 



-7r < argz < 



2' 



- < SXgZ < 7T, 
7T 

-7T < argz < -, 
-— < arg z < 7r, 



-7r < argz < 



Forn = 0,1,2,. 



I n (z) = r n J n (iz), Y n (iz) = i n+l I n (z) - - i~ n K n (z), 
I- n (z) = I n (z), K- V (z) = K v (z), for any v. 
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4. Recursion relationships 

. . 2v . . . . . . 2v . . 

I„-i{z) - h+i(z) = —I„(z), K v+ i(z) - K„-i(z) = —K v {z), 

+ h+i{z) = 2l' v (z), K v _ x {z) + K v+1 (z) = -2K' v (z). 

5. Integrals 

"1 p 7T * p OO 

I v (z) = - e zcosB cos(v0)d0 e- vt - zcosht dt 
k Jo * Jo 

V^r [u + 2 ) Jo 

Re v > — i, z complex, z ^ 0. 

/•OO 

( z ) = / e " z cosh * cosh(i4) tft 
Jo 



2 /'OO 



1 



^%r- / e- 2rf f-5(t+ir-*dt, 

r (" + 2 ) -A) 



Re i/ > -i, Re z > 0. 



X„(xz) = — i — 2l ! \ r dt, 

Re v > — i, x > 0, |argz| < \k. 
When v = n (an integer), the second integral in the first relation disappears. 



6.19.15 AIRY FUNCTIONS 

1. Differential equation 

y" -zy = 0. 

2. Solutions are Ai(z) and Bi(z): 

Ai(z) = cif(z) - c 2 g(z), 
m(z) = V3[c 1 f(z) + c 2 g(z)} 

where 

/(*) = i+r s + V* a + T* 9+ -' 

. . 2 4 2-5 7 2-5-8 10 

ff (z) = z + -z 4 + — z T + __ z io + ___ i 

Cl = Ai(0) = Bi(0)/>/3 = 3" 2/3 r(|) = 0.35502 80538 87817, 
c 2 = - Ai'(0) = Bi'(0)/V3 = 3 _1/3 r(|) = 0.2588194037 92807. 
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FIGURE 6.10 

Graphs of the Airy functions Ai(x) and Hi(x), x real. 



2 






/ Bi(*) 


1 






\AiW 

— -i 


\Y/ \V/ \ V/ W / \ V / \ \/ h i 


1 


-i 





3. Wronskian relation 

Ai(z)Bi'(z) - Ai'(z) Bi(z) = K 

4. Relations with the Bessel functions 
Let ( = \z%, then 

Ai(z) = ^/I [/_.(£) -/.(£)] 
Ai(-2) = i^[j,(C) + J_i(C)] 

Bi(z) = y|[/_. (0 + ^(0] ■ 
Bi(-z) = ^§ ['-*«) -/*«)] 

5. Integrals for real a; 

1 f°° 

Ai(x) = - cos (|-i 3 + xt) dt, 
k Jo 

poo ^ /*oo 

Bi(x) = - / e -^ +xt dt+- sin (k 3 + a;*) A. 
Wo Wo 
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I arg 2 1 < 7T, 

|arg£| < |tt, 

, 2 
| arg2:| < -7T, 

|arg£| < -7T. 



6.19.16 NUMERICAL VALUES FOR THE BESSEL FUNCTIONS 



X 




Ji (x) 




Y-i (x) 


0.0 


1 00000000 


00000000 


— 00 


— 00 


0.2 


99002497 


09950083 


-1 08110532 


-3 32382499 


0.4 


96039823 


19602658 


—0 60602457 


— 1 78087204 


0.6 


Q1 200486 


28670099 


—0 30850987 


— 1 26039135 


0.8 


0.84628735 


0.36884205 


-0.08680228 


-0.97814418 


1.0 


0.76519769 


0.44005059 


0.08825696 


-0.78121282 


1.2 


0.67113274 


0.49828906 


0.22808350 


-0.62113638 


1.4 


0.56685512 


0.54194771 


0.33789513 


-0.47914697 


1.6 


0.45540217 


0.56989594 


0.42042690 


-0.34757801 


1.8 


0.33998641 


0.58151695 


0.47743171 


-0.22366487 


2.0 


0.22389078 


0.57672481 


0.51037567 


-0.10703243 


2.2 


0.11036227 


0.55596305 


0.52078429 


0.00148779 


2.4 


0.00250768 


0.52018527 


0.51041475 


0.10048894 


2.6 


-0.09680495 


0.47081827 


0.48133059 


0.18836354 


2.8 


-0.18503603 


0.40970925 


0.43591599 


0.26354539 


3.0 


-0.26005195 


0.33905896 


0.37685001 


0.32467442 


3.2 


-0.32018817 


0.26134325 


0.30705325 


0.37071134 


3.4 


-0.36429560 


0.17922585 


0.22961534 


0.40101529 


3.6 


-0.39176898 


0.09546555 


0.14771001 


0.41539176 


3.8 


-0.40255641 


0.01282100 


0.06450325 


0.41411469 


4.0 


-0.39714981 


-0.06604333 


-0.01694074 


0.39792571 


4.2 


-0.37655705 


-0.13864694 


-0.09375120 


0.36801281 


4.4 


-0.34225679 


-0.20277552 


-0.16333646 


0.32597067 


4.6 


-0.29613782 


-0.25655284 


-0.22345995 


0.27374524 


4.8 


-0.24042533 


-0.29849986 


-0.27230379 


0.21356517 


5.0 


-0.17759677 


-0.32757914 


-0.30851763 


0.14786314 
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6. Asymptotic behavior 

Let £ = \z% . Then, for z — > oo, 

Ai(z) = ^=z-*e-< [1 + 0(0], 

Bi(z) = -±=z-*e< [1 + 0(0]. 

Ai(-z) = -±=z"* [sin (C + ±tt) + O (O] , 

Bi(-z) = — U"* [cos (C + ±tt) + O (C 1 )] , 



X 


e x I (x) 


e x I\ (x) 


e x K (x) 


e x K 1 (x) 


0.0 


1 


nnnnnnnn 

uuuuuuuu 


n 

u 


nnnnnnnn 

uuuuuuuu 




OO 




OO 


0.2 


n 

u 




n 

u 




9 




o 


ooooo\jy.jo 


0.4 





69740217 





13676322 


1 


66268209 


3 


25867388 


0.6 





59932720 





17216442 


1 


41673762 


2 


37392004 


0.8 





52414894 





19449869 


1 


25820312 


1 


91793030 


1.0 


n 

u 




u 


9n7Q1 n49 


1 
± 




1 


uou luu^y 


1.2 


n 


41 Q78208 


n 


21 525686 


I 


n5748453 


I 


44289755 


1.4 





38306252 





21850759 





98807000 


1 


30105374 


1.6 





35331500 





21901949 





93094598 


1 


19186757 


1.8 





32887195 





21772628 





88283353 


1 


10480537 


2.0 


n 


30850832 


n 

yj 


21 526929 


n 

yj 


841 56822 


x 


03347685 

U004 1 UOfJ 


2.2 


n 


291 31 733 


n 

yj 


21 208773 


(] 

u 


80565398 


n 

yj 


9737701 7 

ij i KJ i (UK 


2.4 





27662232 





20848109 





77401814 





92291367 


2.6 





26391400 





20465225 





74586824 





87896728 


2.8 





25280553 





20073741 





72060413 





84053006 


3.0 


n 

yj 


24300035 


n 




n 

yj 


697761 60 

1 1 U 1UU 


n 

yj 


80656348 


3.2 


n 


23426883 


n 

yj 


1 9297862 


o 

u 


6769751 1 


n 

yj 


77628028 


3.4 





22643140 





18922985 





65795227 





74907206 


3.6 





21934622 





18560225 





64045596 





72446066 


3.8 





21290013 





18210758 





62429158 





70206469 


4.0 





20700192 





17875084 





60929767 





68157595 


4.2 





20157738 





17553253 





59533899 





66274241 


4.4 





19656556 





17245023 





58230127 





64535587 


4.6 





19191592 





16949973 





57008720 





62924264 


4.8 





18758620 





16667571 





55861332 





61425660 


5.0 





18354081 





16397227 





54780756 





60027386 



6.20 ELLIPTIC INTEGRALS 



6.20.1 DEFINITIONS 

Any integral of the type J R(x,y) dx, where R(x,y) is a rational function of x 
and y, with y 2 being a polynomial of the third or fourth degree in x (that is y 2 = 
aox 4 + a\x z + a-ix 2 + a^x + 04 with |ao| + |ai | > 0) is called an elliptic integral. 
All elliptic integrals can be reduced to three basic types. 
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1. Elliptic integral of the first kind 

F(cf>,k) = / -= 
Jo VI 



Vl - k 2 sin 2 i 

r dt 

Jo 7?f 



^/(i-i 2 )(i-pi 2 )' 

2. Elliptic integral of the second kind 

E(4>, k)= I y/\ - k 2 sin 2 6 d6 
Jo 

VI - Pi 2 



a; = sin (A, A; 2 < 1. 



Jo 



vT^i 2 " 

3. Elliptic integral of the third kind 

1 d0 



dt, x = sind>, k < 1. 



II(n; A;) 



o 1 + n sin 2 6 VI - A; 2 sin 2 I 

r __i a 

./o 1 + nt 2 vTT 



^/(l-t 2 )(l-k 2 t 2 )' 



a; = sin (A, A; < 1, 



where for n < — 1 the integral should be interpreted as a Cauchy principal 
value integral. 



6.20.2 PROPERTIES 

1. The complete elliptic integrals of the first and second kinds are 

K =K(k) = F{\,k)= jT /2 (l - A; 2 sin 2 t) " 1/2 dt = \f Q, \; 1; fc 2 ) , 

AT(a) = / 7 (1 -sin 2 asin 2 i)" 1/2 (if, 
ao 

£ =£(A0 = B =j*'\l - k' sin 2 t) 1/2 dt = \F 1 1; A; 2 ) , 

£(a) = / (1 - sin 2 a sin 2 t) 1/2 eft, 
•/o 

where F (±\, \\ 1; A; 2 ) is the Gauss hypergeometric function. 



2. Complementary integrals 

In these expressions, primes do not mean derivatives 

r*7 2 



TV = Jf'(jfe) = K(k') = jT (1 - (1 - A; 2 ) sin 2 t) 1/2 dt = F (|, jfe') , 
£' = = E(fc') = jT' (1 - (1 - A; 2 ) sin 2 t) 1/2 dt = E (|, jfe') , 
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k is called the modulus; k 1 = \/\ — k 2 is called the complementary modulus. 

3. The Legendre relation is 

KE' +EK' - KK' = |. 

4. Extension of the range of <f> 

F(w, k) = 2K, E(TT,k)=2E, 
and, for m = 0, 1, 2, ... , 

F(<f> + mir, k) = toF(tt, k) + F(<f>, k) = 2mK + F(<f>, k), 
E(4> + mir, k) = mE(n, k) + E(<j>, k) = 2mE + E(<p, k) . 



6.20.3 NUMERICAL VALUES OF THE ELLIPTIC INTEGRALS 



/ v 1/2 

F(4>, a) = I (l — sin 2 a sin 2 t) dt (note that k = sin a) 
Jo 

a 



4> 


0° 


10° 


20° 


30° 


40° 


50° 


60° 


70° 


80° 


90° 


0° 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


10° 


0.175 


0.175 


0.175 


0.175 


0.175 


0.175 


0.175 


0.175 


0.175 


0.175 


20° 


0.349 


0.349 


0.350 


0.351 


0.352 


0.353 


0.354 


0.355 


0.356 


0.356 


30° 


0.524 


0.524 


0.526 


0.529 


0.533 


0.538 


0.542 


0.546 


0.548 


0.549 


40° 


0.698 


0.700 


0.704 


0.712 


0.721 


0.732 


0.744 


0.754 


0.760 


0.763 


50° 


0.873 


0.876 


0.884 


0.898 


0.917 


0.940 


0.965 


0.988 


1.004 


1.011 


60° 


1.047 


1.052 


1.066 


1.090 


1.123 


1.164 


1.213 


1.262 


1.301 


1.317 


70° 


1.222 


1.229 


1.250 


1.285 


1.337 


1.407 


1.494 


1.596 


1.692 


1.735 


80° 


1.396 


1.406 


1.434 


1.485 


1.560 


1.666 


1.813 


2.012 


2.265 


2.436 


90° 


1.571 


1.583 


1.620 


1.686 


1.787 


1.936 


2.157 


2.505 


3.153 


oo 



/ 1/2 

E((f>, a) = (l — sin 2 a sin 2 t) dt (note that k = sin a) 
Jo 

a 



4> 


0° 


10° 


20° 


30° 


40° 


50° 


60° 


70° 


80° 


90° 


0° 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


10° 


0.175 


0.175 


0.174 


0.174 


0.174 


0.174 


0.174 


0.174 


0.174 


0.174 


20° 


0.349 


0.349 


0.348 


0.347 


0.346 


0.345 


0.344 


0.343 


0.342 


0.342 


30° 


0.524 


0.523 


0.521 


0.518 


0.514 


0.510 


0.506 


0.503 


0.501 


0.500 


40° 


0.698 


0.697 


0.692 


0.685 


0.676 


0.667 


0.657 


0.650 


0.645 


0.643 


50° 


0.873 


0.870 


0.861 


0.848 


0.832 


0.813 


0.795 


0.780 


0.770 


0.766 


60° 


1.047 


1.043 


1.029 


1.008 


0.980 


0.949 


0.918 


0.891 


0.873 


0.866 


70° 


1.222 


1.215 


1.195 


1.163 


1.122 


1.075 


1.027 


0.983 


0.951 


0.940 


80° 


1.396 


1.387 


1.360 


1.316 


1.259 


1.193 


1.122 


1.056 


1.005 


0.985 


90° 


1.571 


1.559 


1.524 


1.467 


1.393 


1.306 


1.211 


1.118 


1.040 


1.000 
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a 


K(a) 


K'[a) 


E(a) 


E'(a) 


k 2 


K(k) 


K'(k) 


E(k) 


E'(k) 


0° 


tt/2 


00 


tt/2 


1 





tt/2 


00 


tt/2 


1 


5° 


1.574 


3.832 


1.568 


1.013 


0.05 


1.591 


2.908 


1.551 


1.060 


10° 


1.583 


3.153 


1.559 


1.040 


0.10 


1.612 


2.578 


1.531 


1.105 


15° 


1.598 


2.768 


1.544 


1.076 


0.15 


1.635 


2.389 


1.510 


1.143 


20° 


1.620 


2.505 


1.524 


1.118 


0.20 


1.660 


2.257 


1.489 


1.178 


25° 


1.649 


2.309 


1.498 


1.164 


0.25 


1.686 


2.157 


1.467 


1.211 


30° 


1.686 


2.157 


1.467 


1.211 


0.30 


1.714 


2.075 


1.445 


1.242 


35° 


1.731 


2.035 


1.432 


1.259 


0.35 


1.744 


2.008 


1.423 


1.271 


40° 


1.787 


1.936 


1.393 


1.306 


0.40 


1.778 


1.950 


1.399 


1.298 


45° 


1.854 


1.854 


1.351 


1.351 


0.45 


1.814 


1.899 


1.375 


1.325 


50° 


1.936 


1.787 


1.306 


1.393 


0.50 


1.854 


1.854 


1.351 


1.351 


55° 


2.035 


1.731 


1.259 


1.432 


0.55 


1.899 


1.814 


1.325 


1.375 


60° 


2.157 


1.686 


1.211 


1.467 


0.60 


1.950 


1.778 


1.298 


1.399 


65° 


2.309 


1.649 


1.164 


1.498 


0.65 


2.008 


1.744 


1.271 


1.423 


70° 


2.505 


1.620 


1.118 


1.524 


0.70 


2.075 


1.714 


1.242 


1.445 


75° 


2.768 


1.598 


1.076 


1.544 


0.75 


2.157 


1.686 


1.211 


1.467 


80° 


3.153 


1.583 


1.040 


1.559 


0.80 


2.257 


1.660 


1.178 


1.489 


85° 


3.832 


1.574 


1.013 


1.568 


0.85 


2.389 


1.635 


1.143 


1.510 


90° 


00 


tt/2 


1 


tt/2 


0.90 


2.578 


1.612 


1.105 


1.531 












0.95 


2.908 


1.591 


1.060 


1.551 












1 


00 


tt/2 


1 


tt/2 



2.0 

Tt/2 

1.0 
0.5 





The complete elliptic integrals E(k) and K(k), < k < 1. 1 



'From Temme, N.M., Special Functions: An Introduction to the Classical Functions of Mathematical 
Physics, John Wiley & Sons, New York, 1996. With permission. 
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6.21 JACOBIAN ELLIPTIC FUNCTIONS 

The Jacobian Elliptic functions are the inverses of elliptic integrals. If u = F{<j>, k) 
(the elliptic integral of the first kind) 

U = / = = / ; (6.21.1) 

Jo vi-psm 2 ^ Jo va-w-* 2 * 2 ) 

with k 2 < 1, then the inverse function is 

(j> = aniii (the amplitude of u). (6.21.2) 

(Note that the parameter k is not always explicitly written.) The Jacobian elliptic 
functions are then defined as 

1. snti = sn(w,fc) = sin<^ = sin(amu) 

2. cn« = ca(u,k) = cos<f> = cos(amu) = \/\ — sn 2 u 

3. dn u = dn(u, k) = \j\-k 2 sin 2 <f> = \A — k 2 sn 2 u 
Note that 

r cn(u,k) df 



y/(l -t 2 ){k' 2 + k 2 t 2 ) 

dn(u,A) ^ 

^(l-W-*' 2 )' 



(6.21.3) 



6.21.1 PROPERTIES 

1. Relationships 



sn 2 (w, k) + cn 2 (u, k) = 1, 

dn 2 (u,k) +k 2 sn 2 (u,k) = 1, 

dn 2 (u, jfe) - A; 2 cn 2 (u, jfe) = 1 - A; 2 = jfe'' 



2. Special values 



(a) sn(0,fc) = 0, (e) sn(w,0) = sinu, (h) sn(u, 1) = tanhu, 

(b) cn(0,fc) = 1, (f) cn (u,0) = cosw, (i) cn(u, 1) = sechu, 

(c) dn(0, k) = 1, (g) dn ( Uj = x> q dn ( Uj ^ = gechu 

(d) am(0, fc) = 0, 
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3. Symmetry properties 



(a) sn(— u) = — sn(u), 

(b) cn(— u) = cn(u), 



(c) dn(— u) = dn(u), 

(d) am(-u) = — am(w). 



4. Addition formulae 

sniicnt)dn« icnusntidnu 



(a) sn(w ± v) 

(b) cn(u ± v) 



(c) dn(u ± v) 



1 — k 2 sn 2 u sn 2 v 
cnucnu^ snudnusntidnti 

1 — k 2 sn 2 u sn 2 i; 
dn u dn t) ^ fc 2 sn u cn usnw cn v 
1 — k 2 sn 2 u sn 2 v 



5. The elliptic functions are doubly periodic functions with respect to the vari- 
able u. The periods of 

sn(u, k) are 4/f and 2iK', 
cn(u,k) are 4/f and 2K + 2iK', 
dn(u,k) are 2/f and UK 1 . 



6.21 .2 DERIVATIVES AND INTEGRALS 

d (' 1 

1. — sntt = cnudnu. 4. / snti du = — (dnu — k cn«). 

au J k 

2- ^cn!i = -sn«dn!i. 5. ^ cnudu = cos _1 (dnu). 

6. y dnudu = ama = sin _1 (snu). 



3. — dnu = — k 2 cnu dn? 
du 



6.21.3 SERIES EXPANSIONS 

sn(u,A0 = u-(l + fc 2 )^ + (l + 14A ; 2 +A ; 4 )^- 
?/ 7 

- (1 + 135fc 2 + 135A; 4 + k 6 )— + . . . , 
cn(u,k) = 1 - ^ + (1 + 4fc 2 )^ - (1 + 44A; 2 + 16fc 4 )^- + . . . , 

2 4 fi 

Q I II II 

dn(u,ife) = 1 - A; 2 — + A; 2 (4 + A; 2 ) — - fc 2 (16 + 44A; 2 + A; 4 )— + . . . . 
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Let the nome q be defined by q = e 7rK / K and v = iru/(2K). Then 
SI1(U ' k) = kK^ 1 - 2»+i Sin t (2n + 

cn(u,k) = — Y, 1 1 2n+1 cos[(2n + 1)„], (6.21.5) 

, , , . 7T 27T q n . . 

dn(u,fc) = — — + — > ^- cos(2nw). 

v ' 2Jl ^ 1 + g 2 ™ v ' 

n—l 



6.22 CLEBSCH-GORDAN COEFFICIENTS 

These coefficients arise in the integration of three spherical harmonic functions (see 
equation 6.10.10 on page 539). 
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m 2 


m J 



(jl + 32 - j)K3 + 3i - hV-ti + 32 - 3i)K 2 3 + 1) 



(j +h+ 32 + 1)1 



(-l) k VUi + ~ m i)Kh + rra 2 )!(j2 - m 2 )!(j + m)!(j - m)\ 

k\(ji + ]2 - 3 - k)\(ji - mi - k)\(]2 + m,2 - k)\(j - j2 +mi + k)\(j - ji - m,2 + k)\ 

1. Conditions: 

(a) Each of { ji , j 2 , j, nil , to 2 , to} may be an integer, or half an integer. Ad- 
ditionally: j > 0, ji > 0, j 2 > and j + ji + j 2 is an integer. 

(b) ji+j 2 ./><>. 

(c) ji ~ h + j > o. 

(d) -ji+32 +3 > 0. 

(e) |mi| < ji, |m 2 | < j 2 , \m\ < j. 



2. Special values: 
(a) 
(b) 
(c) 
(d) 
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nil 
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to 



if nil + ni2 ^ to. 



when ji + j 2 + j is an odd integer. 
= when 2ji + j is an odd integer. 



3. Symmetry relations: all of the following are equal to 
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-m,2 —nil 
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(b) (-l)h+h-i 

(c) (-1) 

(d) ^f^^L(-l) h+m2 
(e) 



J2 Jl J 

mi TO2 m 

ji+h-j [ J 1 J2 
mi —mi 

j n 

-to mi 



2ji + l 

(f) A /^(-l) i " m+il - mi 



J 

m 



Oil I Jl 

j 

m 



J2 
mi 

j 

— TO 
jl 

-mi 



Ji 

— TOi 
J2 

"TO 2 

j 
— TO 

J2 
-TO 2 

J2 
TO 2 



Jl 
TOi 

Jl 
— TOi 



By use of the symmetry relations, Clebsch- 
the standard form j\ < j 2 < j and to > 0. 



Gordan coefficients may be put in 
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6.23 INTEGRAL TRANSFORMS: PRELIMINARIES 



1. I = (a, b) is an interval, where — oo < a < b < oo. 

2. L 1 (I) is the set of all absolutely integrable functions on I. In particular, L 1 (E) 
is the set of all absolutely integrable functions on the real line R. 

3. L 2 (I) is the set of all square integrable functions on I (i.e., J T \f(x)\ 2 dx < oo). 

4. If / is integrable over every finite closed subinterval of I, but not necessarily 
on I itself, we say that / is locally integrable on /. For example, the func- 
tion f(x) = 1/x is not integrable on the interval I = (0, 1), yet it is locally 
integrable on it. 

5. A function f(x), defined on a closed interval [a, b], is said to be of bounded 
variation if there is an M > such that, for any partition a = xq < x\ < 

n 

■ ■ ■ < x n = b, the following relation holds: ^ \ f(xi) — f{xi-\) \ < M. 

i=l 

6. If / has a derivative /' at every point of [a, b], then by the mean value theorem, 
for any a < x < y < b, we have f(x) — f(y) = f'(z)(x — y), for some 
x < z < y. If /' is bounded, then / is of bounded variation. 

7. The left limit of a function f(x) at a point t (if it exists) will be denoted by 
lim^^j- f(x) = f(t—), and likewise the right limit at t will be denoted by 

lim a ._, t + f{x) = f(t+). 



6.24 FOURIER TRANSFORM 

The origin of the Fourier integral transformation can be traced to Fourier's celebrated 
work on the Analytical Theory of Heat, which appeared in 1822. Fourier's major 
finding was to show that an "arbitrary" function defined on a finite interval could 
be expanded in a trigonometric series (series of sinusoidal functions, see Section 
1 .4). In an attempt to extend his results to functions defined on the infinite interval 
(—oo, oo), Fourier introduced what is now known as the Fourier integral transform. 
The Fourier integral transform of a function f(t) is defined by 




(6.24.1) 



whenever the integral exists. 

There is no universal agreement on the definition of the Fourier integral trans- 
form. Some authors take the kernel of the transformation as e so that the kernel 
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of the inverse transformation is e %tu . In either case, if we define the Fourier transform 

as 

/oo 
/(i)e ±a - dt, 
-OO 

/OO 
f{u))e^ itul duj, (6.24.2) 
-OO 

for some constants a and b, with ab = 1/2tt. Again there is no agreement on the 
choice of the constants; sometimes one of them is taken as 1 so that the other is 
1 / (2tt). For the sake of symmetry, we choose a = b = 1/ y/2n. The functions / and 
/ are called a Fourier transform pair. 

Another definition that is popular in the engineering literature is the one in which 
the kernel of the transform is taken as e 27T%tu (or e ~ 27Tttu ) S o that the kernel of the 
inverse transform is e - 2nltu (or e 2nltu ). The main advantage of this definition is that 
the constants a and b disappear and the Fourier transform pair becomes 

/OO roo 
f(t)e ±27Titu dt and f(t) = / f(u)e :¥2iritu dco. (6.24.3) 
-oo J — OO 

The Fourier cosine and sine coefficients of f(t) are defined by 

1 f°° 1 f°° 

a(u)) = - f{t)cosu)tdt and b(u) = - f(t)smutdt. (6.24.4) 

7T 7-oo f J-oo 

The Fourier cosine and sine coefficients are related to the Fourier cosine and 
sine integral transforms. For example, if / is even, then a{w) = ^j2/itF c (uj) and, if 
/ is odd, b(u) = ^flfirFsiu)) (see Section 6.24.7). 

Two other integrals related to the Fourier integral transform are Fourier's re- 
peated integral and the allied integral. Fourier's repeated integral, S(f, t), of f(t) is 
defined by 

POO 

Jo 

-j^ roo roo 

= — doj f (x) cos u(t — x)dx. 

K Jo J-oo 

The allied Fourier integral, S(f, t), of / is defined by 

POO 

S(f,t) = / (b(co) cosiw — a(uj) siniw) dco, 
Jo 



(6.24.5) 



1 f°° /*°° 

— / du f(x) sin u(x — t)dx. 

^ Jo J-oo 



(6.24.6) 



6.24.1 EXISTENCE 

For the Fourier integral transform to exist, it is sufficient that / be absolutely inte- 
grate on (—oo, oo), i.e., / £ _L 1 (M). 
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THEOREM 6.24.1 (Riemann-Lebesgue lemma) 

If f £ L 1 (E), then its Fourier transform f(oj) is defined everywhere, uniformly 
continuous, and tends to zero as to — > ±00. 



The uniform continuity follows from the relationship 




iht 



- 1 dt, 



and the tendency toward zero as lo — > ±00 is a consequence of the Riemann- 
Lebesgue lemma. 

THEOREM 6.24.2 (Generalized Riemann-Lebesgue lemma) 

Let f £ L 1 (/), vv/zere / = (a, b) is finite or infinite and let u) be a real variable. Let 
a < a 1 <b' < band f u (\,a! ,V) = f 6 ,' f(t)e iXut dt. Then lim f u (\,a!,V) = 0, 
and the convergence is uniform in a 1 andb'. In particular, lim f(t)e ttjjt dt = 0. 



6.24.2 PROPERTIES 

1. Linearity: The Fourier transform is linear, 



T [af(t) + bg(t)} ( W ) = tLF [/(*)] (w) + hT [g(t)} (oj) = af(u>) + bg(u>), 



where a and b are complex numbers. 



2. Translation: T [f(t — b)] (to) = e 



7M- 



3. Dilation (scaling): !F[f(at)} (u) 



a > 0. 



4. Translation and dilation: 




a > 0. 



5. Complex conjugation: T [/(*)] ( w ) = /( — w )- 

6. Modulation: T [e iat f(t)] (to) = f(uj + a), and 




(6.24.7) 



7. Differentiation: If /(*) G L 1 (IK), for jfe = 0, 1, 2, • • • , n and 
lim| iK oo / W (f) = for k = 0, 1, 2, • • • , n - 1, then 




(6.24.8) 
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8. Integration: Let / G ^(ffi), and define g(x) = Jl^fitfdt. If g G L^ffi), 
then<?(w) = -/(cj)/(icj). 

9. Multiplication by polynomials: If t k f(t) G L 1 (IK) for fc = 0, 1, . . . , n, then 

^ [**/(*)] M = ^ r / ( * ) M> (6-24.9) 

and hence, 



J 7 



L \A=0 



10. Convolution: The convolution operation, ★, associated with the Fourier trans- 
form is defined as 

1 f°° 

Ht) = (f*g)(t) = -= f(x)g(t - x)dx, 
V 2ir J-oo 



where / and g are defined over the whole real line. 
THEOREM 6.24.3 

Iff and g belong to L 1 (K), then so does h. Moreover, h(oj) = f(u))g(u)). If 
f and g belong to L 1 (K), then (/ ★ g)(oj) = (fg)(u). 

1 1 . Parseval 's relation: If /, g G L 2 (E), and if F and G are the Fourier transforms 
of / and g respectively, then Parseval's relation is 

/OO rOO 
F(uj)G(uj)duj = / f(t)g(-t)dt. (6.24.11) 
-OO J — OO 

Replacing G by G ( so that g(—t) is replaced by g(t)) results in a more conve- 
nient form of Parseval's relation 

/OO rOO 
F{uj)G(uj)duj = I f(t)g(t)dt. (6.24.12) 
-OO J —OO 

In particular, for f = g, 

/OO POO 
\F(lo)\ 2 dco = / \f(t)\ 2 dt. (6.24.13) 
-co J — OO 
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6.24.3 INVERSION FORMULA 



Many of the theorems on the inversion of the Fourier transform are based on Dini's 
condition which can be stated as follows: 

If / £ i 1 (IR), then a necessary and sufficient condition for 



S(f,x)= lim - f(t) 

A-S-oo 7T J_ OQ 



sin A(a; — t) 
(x-t) 



dt = a 



is that 



lim /' (f(x + y) + f(x -y)- 2a) S -^dy = 0, 



A— too 



y 



for any fixed S > 0. 

By the Riemann-Lebesgue lemma, this condition is satisfied if 



r 

Jo 



fix + y) + fix - y) - 2a 



y 



dy < oo, 



(6.24.14) 



(6.24.15) 



(6.24.16) 



for some 6 > 0. In particular, condition (6.24.16) holds for a = fix), if / is 
differentiable at x, and for a = [fix+) + fix—)] /2, if / is of bounded variation in 
a neighborhood of x. 



THEOREM 6.24.4 (Inversion theorem) 

Let f be a locally integrable function, of bounded variation in a neighborhood of the 
point x.Iff satisfies either one of the following conditions: 

1. f(t) e L^ffi), or 

2- + \t\) £ L 1 (IK), and the integral fit)e ttjjt dt converges uniformly 

on every finite interval ofu, 

then 

I fiuj)e~ ixu doj = lim [ fiw)e- ixu doj 

V27T 7_oo A ^°° V27T J-\ 

is equal to [/(#+) + fix—)} /2 whenever the expression has meaning, to fix) when- 
ever fix) is continuous at x, and to fix) almost everywhere. If f is continuous and 
of bounded variation in the interval (a, b), then the convergence is uniform in any 
interval interior to (a, b). 



6.24.4 POISSON SUMMATION FORMULA 

The Poisson summation formula may be written in the form 



7= E /(*+ — )=- E H^a)e-^\ a>0, (6.24.17) 
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provided that the two series converge. A sufficient condition for the validity of Equa- 
tion (6.24.17) is that / = 0(1 + \t\)- a as \t\ -» oo, and / = O ((1 + \io\)~ a ) as 
|cj| -» oo for some a > 1. 

Another version of the Poisson summation formula is 

£ f(u + kaY 9 (u + ka) = - £ ( ^ f{t)g(t-—\ dt)e 2 ^l°. 

k = -oo ° k=-oo V7 -°° V a J J 

(6.24.18) 



6.24.5 SHANNON S SAMPLING THEOREM 

If / is a function band-limited to [—a, a], i.e., 

f(t) = -±= J" F(oj)e^ doj, 

with F £ L 2 (—a, a), then it can be reconstructed from its sample values at the points 
tk = {kit) /a, k = 0, ±1, ±2, • • • , via the formula 

/(*)= E m f n f t¥ > (6 - 2419) 

with the series absolutely and uniformly convergent on compact sets. 

The series on the right-hand side of Equation (6.24.19) can be written as 
00 (-1)* 

sin at > f{tk)-, ; — r , which is a special case of a Cardinal series (these se- 

k _ ~ kit) 

°° (-1)* 

ries have the form sin at > C k ; — r )• 

^— ' (at — kit) 

K— — 00 

6.24.6 UNCERTAINTY PRINCIPLE 

Let T and W be two real numbers defined by 

T 2 =„ t 2 \f{t)?dt and W 2 = - / oj 2 \f(oj)\ 2 cLj, (6.24.20) 

& J-oo & J-oo 

where 

/oo />oo 
\f(t)\ 2 dt= / |/M| 2 d£j. (6.24.21) 

Assuming that / is differentiable and lim tf 2 (t) = 0, then 2TW > 1, or 

\t\— too 

/oo \ 1/2 / nOO \ 1/2 -j /-OO 

i 2 |/(i)| 2 di / u 2 \f(u)\ 2 du) >-/ |/(i)| 2 dt. (6.24.22) 

-oo / \J — oo / ^ J —oo 

This means that / and / cannot both be very small. Another related property of the 
Fourier transform is that, if either one of the functions / or / vanishes outside some 
finite interval, then the other one must trail on to infinity. In other words, they can 
not both vanish outside any finite interval. 
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6.24.7 FOURIER SINE AND COSINE TRANSFORMS 

The Fourier cosine transform, F c (u>), and the Fourier sine transform, F s (u>), of f(t) 
are defined for cj > as 

[2 f°° [2 f°° 

F c (u) = \ — / f(t)cosu)tdt and F s (uS) = \ — \ f (t) sin ujt dt . 

(6.24.23) 

The inverse transforms have the same functional form: 

f(t) = ^ J F c {w) cosutduj = ^ J F s (oj) sincjidcj. (6.24.24) 

If / is even, i.e., f(t) = f(—t), then F(u) = F c (u), and if / is odd, i.e., 

/(*) = -/(-*). *en F(lo) = iF s (co). 



6.25 DISCRETE FOURIER TRANSFORM (DFT) 

The discrete Fourier transform of the sequence {on}^ 1 , where N > 1, is a se- 
quence {A m }^Zl, defined by 

A r -1 

A m = Y, an(W N ) mn , for m = 0, 1, • • • , N - 1, (6.25.1) 

where W N = e 2ni / N . Note that Ylmll W™ (k ~ n) = NS kn . For example, the DFT 
of the sequence {1, 0, 1, 1} is {3, —i, 1, i}. 
The inversion formula is 

JV-l 

a n = -J2 A ™ W N m "> n = 0,l,--- ,N-1. (6.25.2) 

m=0 

Equations (6.25.1) and (6.25.2) are called a discrete Fourier transform (DFT) pair of 
order N. The factor 1/N and the negative sign in the exponent of W m that appear 
in Equation (6.25.2) are sometimes introduced in Equation (6.25.1) instead. We use 
the notation 

T N [(a n )] = A m ^'[(AJ] = an, (6.25.3) 

to indicate that the discrete Fourier transform of order N of the sequence {a n } is 
{A m } and that the inverse transform of {A m } is {a n }. 

Because w^ (m+N)n = W+ mn , Equations (6.25.1) and (6.25.2) can be used to 
extend the sequences {a n }^~Q and {4 m }*lJ, as periodic sequences with period 
N. This means that A m+ w = A m , and a n+ N = a n - This will be used in what 
follows without explicit note. Using this, the summation limits, and N - 1, can 
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be replaced with n\ and n\ + N — 1, respectively, where ni is any integer. In the 
special case where ri\ = —M and N = 2M + 1, Equations (6.25.1) and (6.25.2) 
become 

M 

A m = ^ a nW% n , for to = —M, -M + 1, • • • ,M — 1, M, (6.25.4) 

n= — M 

and 

1 M 

a " = 2M+T ^ A ™ W N m "> for n = -M,-M + l,---,M-l,M. 

m=-M 

(6.25.5) 



6.25.1 PROPERTIES 

1. Linearity: The discrete Fourier transform is linear, that is 

T N [a{a n ) + P{b n )} = aA m + /3B m , 

for any complex numbers a and /3, where the sum of two sequences is defined 

as (a n ) + (&„) = (a n + b n ). 

2. Translation: T N [(a n . k )] = W% k A m ,or e 2M / N A m = a n - k W^ n . 

3. Modulation: T N [(W% k a n )} = A m+k , or A m+k = e 2 * ink ' N a n W% n . 

4. Complex Conjugation: J"jv[(a_„)] = A m , or A m = 2~2n=o a- n W™ n . 

5. Symmetry: T N [(a- n )\ = A_ m ,or A_ m = J2^o a-„W% n . 

6. Convolution: The convolution of the sequences {a n }^Q and {b n }n=o is the 
sequence {c n }^~Q given by 

JV-1 

c ™ = E a kb n -k- (6.25.6) 

The convolution relation of the DFT is J 7 jv[(c„)] = •Fjv[(a r ()].7 : Jv[(frr()]> or 
C m = A m B m . A consequence of this and Equation (6.25.2), is the relation 

JV-1 JV-1 

E a kbn-k = E A m B m W^ mn . (6.25.7) 



N 

k—0 m—0 



7. Parseval's relation: 



In particular, 



JV-1 ^ JV-1 

n— m—0 



JV-1 , JV-1 



(6.25.8) 



EKl 2 = ^El^l 2 - ^ 25 - 9 > 



jV 

n— m—0 
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In (4) and (5), the fact that W jv = W^- 1 has been used. A sequence {a„} is said 
to be even if {a_„} = {a„} and is said to be odd if {a_„} = {— a„}. The following 
are consequences of (4) and (5): 

1. If {a n } is a sequence of real numbers (i.e., = a n ), then A m = A_ m . 

2. {a n } is real and even if and only if {A m } is real and even. 

3. {a n } is real and odd if and only if {A m } is pure imaginary and odd. 



6.26 FAST FOURIER TRANSFORM (FFT) 

To determine A m for each m = 0, 1, • • • , M — 1 (using Equation (6.25.1)), M — 1 
multiplications are required. Hence the total number of multiplications required to 
determine all the A m 's is (M — l) 2 . This number can be reduced by using decima- 
tion. 

Assuming M is even, we define M = 2N and write 

^ 2 jv[(a„)] = A m . (6.26.1) 

Now split {a n } into two sequences, one consisting of terms with even subscripts 
(b„ = a,2n) and one with odd subscripts (c„ = a,2 n +i)- Then 

A m = B m + W? N C m . (6.26.2) 

For the evaluation of B m and C m , the total number of multiplications required is 
2(N — l) 2 . To determine A m from Equation (6.26.2), we must calculate the product 
W^jqC m , for each fixed m. Therefore, the total number of multiplications required 
to determine A m from Equation (6.26.2) is 2(N - 1) 2 + - 1 = 2N 2 - 2N + 1. 

But if we had determined A m from (6.26.1), we would have performed (2A^ — 
l) 2 = 4Af 2 — 4A^ + 1 multiplications. Thus, splitting the sequence {a n } into two 
sequences and then applying the discrete Fourier transform reduces the number of 
multiplications required to evaluate A m approximately by a factor of 2. 

If N is even, this process can be repeated. Split {b n } and {c„} into two se- 
quences, each of length N/2. Then B m and C m are determined in terms of four 
discrete Fourier transforms, each of order N/2. This process can be repeated k — 1 
times if M = 2 k for some positive integer k. 

If we denote the required number of multiplications for the discrete Fourier 
transform of order N = 2 k by F(N), then F(2N) = 2F(N) + N and F(2) = 1, 
which leads to F(N) = f log 2 N. 
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6.27 MULTIDIMENSIONAL FOURIER TRANSFORM 

If x = (xi, X2, ■ ■ ■ ,x„) and u = (m, ui, . . . ,u„), then (see table on page 604): 

1. Fourier transform F(u) = (2tt) "™/ 2 / ■ ■ ■ / f(x)e i ^ u '> dx. 

R" 

2. Inverse Fourier transform /(x) = (2tt) "™/ 2 / ■ ■ ■ / F(u) e -*( x - u ) du. 

R" 

3. Parseval's relation J ■■■ J f(x)g(x) dx = J ■■■ J F(u)G(u) du. 

R" R" 



6.28 LAPLACE TRANSFORM 

The Laplace transformation dates back to the work of the French mathematician, 
Pierre Simon Marquis de Laplace (1749-1827), who used it in his work on probabil- 
ity theory in the 1780's. 

The Laplace transform of a function /(£) is defined as 

POO 

F(s) = [£f](s)= / f(t)e- st dt (6.28.1) 
Jo 

(also written as [£/(£)] and [C (/(£))] ), whenever the integral exists for at least one 
value of s. The transform variable, s, can be taken as a complex number. We say 
that / is Laplace transformable or the Laplace transformation is applicable to / if 
[£/] exists for at least one value of s. The integral on the right-hand side of Equation 
(6.28.1) is called the Laplace integral of /. 



6.28.1 EXISTENCE AND DOMAIN OF CONVERGENCE 

Sufficient conditions for the existence of the Laplace transform are 

1. / is a locally integrable function on [0, oo), i.e., |/(£)| dt < oo, for any 
a > 0. 

2. / is of (real) exponential type, i.e., for some constants M, £ > and real 7, / 
satisfies 

|/(£)| < Me 7 *, forall£>£ . (6.28.2) 

If / is a locally integrable function on [0, 00) and of (real) exponential type 7, 
then the Laplace integral of /, J °° f{t)e~ st dt, converges absolutely for Re s > 7 
and uniformly for Re s > 71, for any 71 > 7. Consequently, F(s) is analytic in 
the half -plane f2 = {s £ C : Re s > 7}. It can be shown that if F(s) exists for 
some s . then it also exists for any s for which Re s > Re s - The actual domain 
of existence of the Laplace transform may be larger than the one given above. For 
example, the function /(£) = cos e* is of real exponential type zero, but F(s) exists 
for Re s > -1. 
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If f(t) is a locally integrable function on [0, oo), not of exponential type, and 

POO 

/ f(t)e~ Sot dt (6.28.3) 
Jo 

converges for some complex number sq, then the Laplace integral 

/•OO 

/ f(t)e~ st dt (6.28.4) 
Jo 

converges in the region Re s > Re so an d a ls° converges uniformly in the region 
|arg(s — s ) | < < f • Moreover, if Equation (6.28.3) diverges, then so does 
Equation (6.28.4) for Re s < Re s . 



6.28.2 PROPERTIES 

1. Linearity: £{af + fig) = a£(f) + pC(g) = aF + f3G, 
for any constants a and /3. 

2. Dilation: [£ (f(at))] (s) = ^j, for a > 0. 

3. Multiplication by exponential functions: 

[£ (e at f(t))](s)= F (s-a). 

4. Translation: [C (f(t - a)H(t - a))} (s) = e - a3 F(s) for a > 0. This can be 
put in the form 

[£(f(t)H(t - a))} (s) = e"" [£(f(t + a))] (s), 

where H is the Heaviside function. Examples: 

(a) If 

g(t) 



0, 0<i<a, 
{t-a) v , a<t, 



then g{t) = f(t - a)H{t - a) where f(t) = i"(Re v > -1). Since 
£(t v ) = T(v + l)/s v+1 , it follows that (£g)(s) = e~ as T{u + 1) / s v+1 , 
for Re s > 0. 

(b) If 

't, 0<t<a, 



g(t) 



0, a <t, 



we may write g(t) = t [H(t) - H(t - a)} = tH(t) -{t- a)H(t - a) 
aH(t — a). Thus by properties (1) and (4), 

G(s) = 1 - \e~ as - -e~ as . 
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5. Differentiation of the transformed function: If / is a differentiable function of 
exponential type, lim i _ i .o+ f(t) = /(0+) exists, and /' is locally integrable 
on [0, oo), then the Laplace transform of/' exists, and 



(£/') ( s )=sF(s)-f(0). 



(6.28.5) 



Note that although / is assumed to be of exponential type, /' need not be. For 
example, f(t) = sine* , but f'(t) = 2te* cose* . 

6. Differentiation of higher orders: Let / be an n times differentiable function 
so that (for k = 0, 1, . . . , n — 1) are of exponential type with the addi- 
tional assumption that lim t _ i .o+ f^ k \t) = /(*)(0+) exists. If is locally 
integrable on [0, oo), then its Laplace transform exists, and 



[C (/W)] (s) = s n F(s) - a-VW - s"- 2 /'(0) 



/(«-i)(0). 
(6.28.6) 



7. Integration: If g(t) = J* * f(x) dx, then (if the transforms exist) G(s) 
F(s)/s. Repeated applications of this rule result in 



[^(/ ( - B) )]w = ^w, 



(6.28.7) 



where /( is the n th anti-derivative of / defined by / ( (t) = J* dt n J Q '" 
dt n -\ ■ ■ ■ Jq 2 f(t\) dt\. Section 6.28.1 shows that the Laplace transform is an 
analytic function in a half -plane. Hence it has derivatives of all orders at any 
point in that half-plane. The next property shows that we can evaluate these 
derivatives by direct calculation. 

8. Multiplication by powers oft: Let / be a locally integrable function whose 
Laplace integral converges absolutely and uniformly for Re s > a. Then F is 
analytic in Re s > a, and (for n = 0, 1, 2, . . ., with Re s > a) 



l£(t n f(t))} (s) 



d_ 

ds 



fit) 



n 

F(s), 



(6.28.8) 



where (i Jj) 



is the operator (i^) applied n times. 



9. Division by powers oft: If / is a locally integrable function of exponential 
type such that f(t)/t is a Laplace transformable function, then 



(s) 



/■OO 
F(u) du, (6.28.9) 



or, more generally, 



V t n 



oo oo oo 

^ (s) = J ■■■ J J F( Sl ) dsi ds 2 ■■■ ds n (6.28.10) 
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is the n th repeated integral. It follows from properties (7) and (9) that 



dx 



(s) = - / du. 



(6.28.11) 



10. Periodic functions: Let / be a locally integrable function that is periodic with 
period T. Then 



[A/)] (») 



1 



(1 -e" T *) 



f(t)e~ st dt. 



(6.28.12) 



11. Hardy's theorem: If /(f) = ££L c„f" fort > and ^ converges 

for some s > 0, then [£(/)] (s) = ^ for Re s > s o- 



6.28.3 INVERSION FORMULAE 
6.28.3.1 Inversion by integration 

If /(f) is a locally integrable function on [0, oo) such that 

1. / is of bounded variation in a neighborhood of a point f > (a right-hand 
neighborhood if to = 0), 

2. The Laplace integral of / converges absolutely on the line Re s = c, then 



lim -L f F(s)e st °ds=\ /(0+)/2 
2 ™i I [/(*>+) - 



if to < 0, 
if to = 0, 
+ f(t -)]/2 if t > 0. 



In particular, if / is differentiable on (0, oo) and satisfies the above conditions, 



then 



c+iT 



lim — / F(s)e st ds = fit), < t < oo. (6.28.13) 

t-s-oo 2m J 

c-iT 

The integral here is taken to be a Cauchy principal value since, in general, this inte- 
gral may be divergent. For example, if f(f) = 1, then F(s) = 1/s and, for c = 1 

l+ioo 

and t = 0, the integral J ^ ds diverges. 

1 — ioo 
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6.28.3.2 Inversion by partial fractions 

Suppose that F is a rational function F(s) = P(s)/Q(s) in which the degree of 
the denominator Q is greater than that of the numerator P. For instance, let F be 
represented in its most reduced form where P and Q have no common zeros, and 
assume that Q has only simple zeros at a\ , . . . , a n , then 

/(,) = £- (F(»)) («) = £- («) = £ |M e «. (6 . 28 , 4) 

EXAMPLE If P{s) = s -5 and Q(s) = s 2 + 6s + 13, then ai = -3 + 2i,a 2 = —3 — 2*, 
and it follows that 

f(t\ - Z- 1 S ~ 5 ^ - ( 2 »- 8 ) r (-3+2i) t , (2» + 8) (-3-2i) t 

U 2 + 65 + 13^" 4i + 4i 

= e" 3 '(cos2t - 4sin2i). 



6.28.4 CONVOLUTION 

Let f(t) and g(t) be locally integrable functions on [0, oo), and assume that their 
Laplace integrals converge absolutely in some half-plane Re s > a. Then the con- 
volution operation, associated with the Laplace transform, is defined by 

i 

h(t) = (f*g)(t) = J f(x)g(t-x)dx. (6.28.15) 
o 

The convolution of / and g is a locally integrable function on [0, oo) that is contin- 
uous if either / or g is continuous. Additionally, it has a Laplace transform given 
by 

H(s) = (Ch) (s) = F(s)G(s), (6.28.16) 
where (£f)(s) = F(s) and (£g)(s) = G(s). 



6.29 HANKEL TRANSFORM 

The Hankel transform of order v of a real-valued function f(x) is defined as 

roc 

= FAv) = / f{x)^J v (yx)dx, (6.29.1) 
Jo 

for y > and i/ > —1/2, where J v {z) is the Bessel function of the first kind of 
order v. 

The Hankel transforms of order 1/2 and —1/2 are equal to the Fourier sine and 
cosine transforms, respectively, because 

J\/2{x) = \ — sina;, J_i/ 2 (a;) = \ — cosa;. (6.29.2) 

' \ TTX ' \ TTX 
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As with the Fourier transform, there are many variations on the definition of the 
Hankel transform. Some authors define it as 

/•OO 

G v (y) = / xg(x)J v (yx)dx; (6.29.3) 



however, the two definitions are equivalent; we only need to replace f(x) by ^/xg{x) 
wAF v (y) by ^/yG v (y). 



6.29.1 PROPERTIES 

1. Existence: Since \fx3 v {x) is bounded on the positive real axis, the Hankel 
transform of / exists if / € I/ 1 (0, oo). 

2. Multiplication by x m : 

U v (x m f(x)) („) = y 1 ^ ^--J [y v+m -" 2 F v+m {y)\ . 



3. Division by x: 



K v ( —fix) )(y) = y (y) + F v+1 (y)} , 



and also 

4. Differentiation: 

U v (2vf(x)) (y) = {y- l/2)yF v+1 (y) - („ + 1/2)i/F„_ 1 (i/). 

5. Differentiation and multiplication by powers of x: 
Id 



x 1 ^ 



■ dx 



(/ +m - 1/J /w) 



(l/)=l/ m F,, +in (l/)- 



6. Parseval's relation: Let F„ and G„ denote the Hankel transforms of order v 
of / and g, respectively. Then 

/■oo /-oo 

/ F v {y)G v {y)dy = / f(x)g(x)dx. (6.29.4) 

In particular, 

/■OO /-OO 

/ |F„(i/)| 2 di/= / \f(x)\ 2 dx. (6.29.5) 

7. Inversion formula: If / is absolutely integrable on (0, oo) and of bounded 
variation in a neighborhood of point x, then 

jT F v (y)^J v (yx)dy = f( x +)+f( x ~\ {629 . 6) 

whenever the expression on the right-hand side of the equation has a meaning; 
the integral converges to f(x) whenever / is continuous at x. 
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6.30 HARTLEY TRANSFORM 

Define the function cas x = cos x + sin x. The Hartley transform of the real function 

g{t) is 

/'CO 
g(t) c&s(2iru>t) dt. (6.30.1) 
-CO 

Let (Eg)(u)) and (Og)(u)) be the even and odd parts of (Hg)(u)) 9 

(Eg)(<») = U(Hg)(v) + (Hg)(-u)), 

\ (6.30.2) 
(Og)(o J ) = -((Hg)(o J )-(Hg)(-o J )), 

so that (Hg)(u) = (Eg)(u)) + (Og)(oj). The Fourier transform of g (using the kernel 
e 2mut ) can then be written in terms of (Eg)(co) and (Og)(co) as 

/oo 
g{i)e M dt = (Eg)(uj) + i(Og)(uj). (6.30.3) 
-oo 

Note that the Hartley transform, applied twice in succession, returns the original 
function. 



6.31 HILBERT TRANSFORM 

The Hilbert transform of / is defined as 

w)(x) = f( X ) =i r M-dt=- r f -^pt dt (6.31.D 

7T J_ 00 t-X 7T J_ OQ t 

where the integral is a Cauchy principal value. A table is on page 612. 

Since the definition is given in terms of a singular integral, it is sometimes im- 
practical to use. An alternative definition is given below. First, let / be an integrable 
function, and define a(t) and b(t) by 

If 00 If 00 
a(t) = — / f(x)costxdx, b(t) = — / f(x) sin tx dx. (6.31.2) 

7T J-cc, K J-cc 

Consider the function F(z), defined by the integral 

F(z)= (a(t) -ib(t))e izt dt = U(z)+iU(z), (6.31.3) 
Jo 

where z = x + iy. The real and imaginary parts of F are 

/•OO 

U(z) = / (a(t) cos xt + b(t) sin xt)e~ yt dt, and 

?oo (6-31.4) 

U(z) = / (a(t) sinxt - b(t) cosxt)e~ yt dt. 
Jo 
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Formally, 

POO 

lim U(z) = f(x) = / (a(t) cosxt + b(t) sinxt) dt, (6.31.5) 
Jo 

and 

/>00 

lim U(z) = -f(x) = / (a(t) sinxt - b(t) cosxt) dt. (6.31.6) 
Jo 

The Hilbert transform of a function /, given by Equation (6.31.5), is defined as 
the function / given by Equation (6.31.6). 



6.31.1 EXISTENCE 

If / G then its Hilbert transform (Hf)(x) exists for almost all x. For / £ 

L p (W),p > 1, there is the following stronger result: 



THEOREM 6.31.1 

Let f € L P (M) for 1 < p < oo. Then (Hf)(x) exists for almost all x and defines a 
function that also belongs to L P (M) with 

/oo roo 
\(-Hf)(x)\ p dx<C p \f(x)\ p dx. (6.31.7) 
-CO J — CO 

In the special case ofp = 2, we have 

/CO POO 
\(Hf)(x)\ 2 dx = / \f(x)\ 2 dx. (6.31.8) 
-oo J — oo 



The theorem is not valid if p = 1 because, although it is true that (Hf)(x) 
is defined almost everywhere, it is not necessarily in L J (E). The function f(t) = 
(t log 2 provides a counterexample. 



6.31.2 PROPERTIES 

1. Translation: The Hilbert transform commutes with the translation operator 

(%f)(x + a)=%(f(t + a))(x). 

2. Dilation: The Hilbert transformation also commutes with the dilation operator 

(Hf)(ax)=H(f(at))(x) a > 0, 

but 

(Hf)(ax) = -n(f(at))(x) for a < 0. 

1 f 00 

3. Multiplication by t: n(tf(t))(x) = x{Uf){x) + - / /(*) dt. 

K J-oo 
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4. Differentiation: n(f'(t))(x) = (Hf)'(x), provided that f(t) = 0(t) as \t\ -» 
oo. 

5. Orthogonality: The Hilbert transform of / G _L 2 (M) is orthogonal to / in the 
sense f(x)(Uf)(x)dx = 0. 

6. Parity: The Hilbert transform of an even function is odd and that of an odd 
function is even. 

1 f°° f(t) 

7. Inversion formula: If CHf)(x) = — dt, then 

7T J_ 00 t-x 



1 f 

/(*) = — / 



da; or, symbolically, 



a; — i 

H(Hf)(x) = -f(x), (6.31.9) 



that is, applying the Hilbert transform twice returns the negative of the original 
function. Moreover, if / G L J (E) has a bounded derivative, then the allied 
integral (see Equation 6.24.6) equals (Hf)(x). 



8. Meromorphic invariance: 

w)(u(x)) = }(u(x)) = - r ,,. 

7T t - U(X) 7T J_ OQ t - X 

where 



oo 

a r , 



for arbitrary a„ > and 6„ real. 



6.31 .3 RELATIONSHIP WITH THE FOURIER TRANSFORM 

From Equations (6.31.3)— (6.31.6), we obtain 

/•OO 

lim F(z) = F(x) = / (a(t) - ib(t))e ixt dt = f(x) - i(Hf)(x), 
y-^° Jo 

where a(t) and b(t) are given by Equation (6.31.2). 

Let g be a real-valued integrable function and consider its Fourier transform 
g[x) = -y= g(t)e txt dt. If we denote the real and imaginary parts of g by / 

and /, respectively, then 

1 f°° 

f(x) = / g(t) cos xtdt, and 

\/2tt J-oo 

1 f°° 

= ~7^= / g(t) sin xtdt. 

V ZTT J-oo 
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Splitting g into its even and odd parts, g e and g , respectively, we obtain 



hence 



f(x) = \ — f g e (t) cosxtdt, and f(x) = \ — I g (t) sin xt dt, 
V 7T ./ V 7T J 



(6.31.10) 



or 



■I roo _ _■ roo 

f(x) = -= g e (ty xt dt, and f(x) = -= g (t)e^ dt. 
V 2ir J-oo V Zir J-oo 

(6.31.11) 

This shows that, if the Fourier transform of the even part of a real-valued function 
represents a function f(x), then the Fourier transform of the odd part represents the 
Hilbert transform of / (up to multiplication by i). 

THEOREM 6.31 .2 

Let f £ L 1 (R) and assume that Hf is also in L 1 (E). Then 

T(Uf)(u>) = -i sgn(a;).F(/)M, (6.31.12) 

where T denotes the Fourier transformation. Similarly, if f € L 2 (M), then (Hf) € 
L 2 (E), and Equation (6.31.12) remains valid. 



6.32 Z-TRANSFORM 

The Z-transform of a sequence {/(n)}^ is defined by 

oo 

Z[f(n)]=F(z)= Y, f{n)z~ n , (6.32.1) 



for all complex numbers z for which the series converges. 

The series converges at least in a ring of the form < r\ < \z\ < r-2 < oo, 
whose radii, n and r-i, depend on the behavior of f(n) at ±oo: 

n = limsup \/|/(n)|, r 2 = lim inf 1 (6.32.2) 

n-s-oo "-*- 00 Vl/( -n )l 

If there is more than one sequence involved, we may denote r i and ri by ri (/) 
and r-zif) respectively. It may happen that n > r 2 , so that the function is nowhere 
defined. The function F(z) is analytic in this ring, but it may be possible to continue 
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it analytically beyond the boundaries of the ring. If f(n) = for n < 0, then 
r2 = oo, and if f(n) = for n > 0, then n = 0. 

Let z = re t9 . Then the Z-transform evaluated at r = 1 is the Fourier transform 
of the sequence {/(n)}^, 

oo 

£ f^)e- in<> . (6.32.3) 



6.32.1 EXAMPLES 

1. Let a be a complex number and define f(n) = a n , for n > 0, and zero 
otherwise, then 

oo 

2[/( n )] = ^ fl V» = — , |z|>|a|. (6.32.4) 



z — a 

n=0 



Special case: unit step function. If a = 1 then f(n) = u(n) 



1, n > 0, 
0, n < 0, 



and Z[u( 



z 



n 



z - 1 

2. If /(n) = na n , for n > 0, and zero otherwise, then 



Z[f(n)] = Y,na n z- n = ——^ , \z\>\a\ 



1 n = 

3. Let<J(n) = ^ ' ' then - k)] = z~ k for fc = 0, ±1, ±2, 

0, otherwise, 



6.32.2 PROPERTIES 

Let the region of convergence of the Z-transform of the sequence {/(n)} be denoted 
by D f . 

1. Linearity: 

Z[af(n)+bg(n)] = aZ[f(n)]+bZ[g(n)] = aF(z) + bG(z), z £ D f DD g . 

The region Df f] D g contains the ring n < \z\ <r^, where 

r\ = maximum {n(/),ri((ji)} andr2 = minimum {r 2(f), r2(g)}- 

2. Translation: Z[f(n - k)} = z~ k F(z). 

3. Multiplication by exponentials: Z[(a n f(n))] = F(z/a) when \a\r\ < \z\ < \a\r^- 
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4. Multiplication by powers of n: For k = 0, 1, 2, . . . and z £ Df, 

Z[(n k f(n))} = (-l) k (zf) " F(z). (6.32.5) 



5. Complex conjugation: Z[f(—n)] = F 

6. Initial and final values: If /(n) = for n < 0, then lim z _ i . 00 F(;z) = /(0) 
and, conversely, if ^(z) is defined for ri < \z\ and for some integer to, 
lim^oo ^ m F(^) = A (with A ^ ±oo), then /(to) = A and /(n) = 0, 
for n < to. 

7. Parseval's relation: Let F,G £ L 2 (-7r,7r), and let and G(z) be the 
Z-transforms of {/(n)} and {gi(n)}, respectively. Then 

V /(n)fl(n) = — / F(e-)G(e-)d W . (6.32.6) 
«^oo 2lr J-* 

In particular, 

n= — oo 




6.32.3 INVERSION FORMULA 

Consider the sequences 

f(n) = u{n) = \ 1, n ^ 0, and g{n) = -u{-n - 1) = \ " ^ °' 

I 0, n < 0, I 0, n > 0. 

Note that = -^-j- for |z| > 1, and G(z) = j- for \A < !• Hence, the 

inverse Z-transform of the function z/(z — 1) is not unique. In general, the inverse 
Z-transform is not unique, unless its region of convergence is specified. 

1 . Inversion by using series representation: 
If F(z) is given by its series 

oo 

F(z) = E a nZ~ n , n < \z\ < r 2 , 

n— — oo 

then its inverse Z-transform is unique and is given by f(n) = a n for all n. 
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2. Inversion by using complex integration: 

If F(z) is given in a closed form as an algebraic expression and its domain of 
analyticity is known, then its inverse Z-transform can be obtained by using the 
relationship 

f(n) = ^~j^ F(z)z n - 1 dz, (6.32.8) 

where 7 is a closed contour surrounding the origin once in the positive (counter- 
clockwise) direction in the domain of analyticity of F(z). 

3. Inversion by using Fourier series: 

If the domain of analyticity of F contains the unit circle, \r\ = 1, and if F is 
single valued therein, then F(e t9 ) is a periodic function with period 27r, and, 
consequently, it can be expanded in a Fourier series. The coefficients of the 
series form the inverse Z-transform of F and they are given explicitly by 



f(n) = — / F{e w )e m0 de. (6.32.9) 

(This is a special case of (2) with 7(0) = e t9 .) 

4. Inversion by using partial fractions: 

Dividing Equation (6.32.4) by z and differentiating both sides with respect to 
z results in 

Z' 1 [(z - a)~ k ] = ( U ~ ]] a n - k u(n - k), (6.32.10) 

for k = 1, 2, . . . and \z\ > \a\ > 0. Moreover, 

Z' 1 [z~ k ] =S(n-k). (6.32.11) 

Let F(z) be a rational function of the form 

F( 1 - P ^ - aNZ * + ' ' ' + aiZ + a ° 
[Z> ~ Q(z) ~ b M z M + ... + b lZ + b 

with a at ^ and bu ^ 0. 

(a) Consider the case N < M. The denominator Q(z) can be factored over 
the field of complex numbers as Q(z) = c(z — z\) kl ■ ■ ■ (z — z m ) km , 
where c is a constant and k\ , . . . , k m are positive integers satisfying k\ + 
. . . + k m = M. Hence, F can be written in the form 

m ki * 

f w = EEAi' (63212) 

UU {z ~ Zi) 



where 



1 d ki ~ j 

A h3 = v —yj™ ^-{z-z^Fiz). (6.32.13) 
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The inverse Z-transform of the decomposition in Equation (6.32.12) in 
the region that is exterior to the smallest circle containing all the zeros of 
Q(z) can be obtained by using Equation (6.32.10). 

(b) Consider the case N > M. We must divide until F can be reduced to 
the form 

where the remainder polynomial, R(z), has degree less than or equal to 
M — 1, and the quotient, H(z), is a polynomial of degree, at most, N — 
M. The inverse Z-transform of the quotient polynomial can be obtained 
by using Equation (6.32.11) and that of R(z)/Q(z) can be obtained as 
in the case N < M. 



EXAMPLE To find the inverse Z-transform of the function 

z* + 5 

(z-inz-2) 

the partial fraction expansion, 



F ( z ) = ~ M > 2 > (6.32.14) 



« 4 + 5 ,6 10 21 

(z-m*-2) =z+4 -(^-—) + T^y (632A5) 

is computed. With the aid of Equation (6.32.10) and Equation (6.32.11), 

Z' 1 [F(z)] = 5{n + 1) + 45 (n) - 6(n - l)u{n - 2) 

- 10u(n - 1) + 21 • 2 n - 1 u(n - 1), (6.32.16) 

or f(n) = -6n - 4 + 21 • 2 n_1 , for n > 2, with the initial values /(-l) = 1, 
/(0) = 4, and/(l) = 11. 

6.32.4 CONVOLUTION AND PRODUCT 

The convolution of the two sequences, and {^(n)}^^ is the sequence 

{M n )}^oo defined by h(n) = XltL-oc f{k)g{n — k). The Z-transform of the 
convolution of two sequences is the product of their Z-transforms, 

Z[h(n)]=Z[f(n)]Z[g(n)}, (6.32.17) 

fovze D f f]D g ,ov H(z) = F(z)G(z). 

The Z-transform of the product of two sequences is given by 

Z[f(n) 9 (n)} = ^-j^ Hu)G (£) ^, (6.32.18) 

where 7 is a closed contour surrounding the origin in the positive direction in the 
domain of convergence of F(u) and G(z /cj). 
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6.33 TABLES OF TRANSFORMS 



Finite sine transforms 

f s (n) = / F(x) sinnxdx, for n = 1, 2, . . . . 
Jo 



No. 


/.(") 


F(x) 


1 
1 




t (7T - X) 


2 


1/n 


7T — x/tT 


3 


(-l) n+1 /n 


x/ir 


4 


1 - (-l)"/n 


1 


5 


2 . ri7r 


\x when < a; < 7r/2 
W— x when 7r/2 < x < ir 


6 


(-i) n+1 /n 3 


x(ir 2 -x 2 )/6ir 


7 


1 - (-l)"/n 3 


x(ir — x) /2 


8 


TT^-l)™" 1 2[l-(-l) n ] 
n n 3 


x 2 


9 


*(-l)» ( 4 - 1L) 


X 3 


1 n 


^ M l -\\n rtrl 

1 ( l)™e C7r 

n l + c l 


e cx 


1 1 
1 1 


n 

n? + c 2 


sinh c(7r — x) 
sinh C7r 




71 

„ , „ witn U,l,z,... 

n z — Ar 


sin k(ir — x) 
sin A:7r 


13 


J 7r/2 when n =m 

1 when n ^ m, m = 1, 2, . . 


Q1 Tl Ti l HP 
Dili III,' 


14 


-= r^[l - (-l) n COSfc7T] 

n 2 - — k l 

with A; ^ 1,2,... (Oifn = fc) 


cos fca; 


15 




7rsinA;a; a; cos k(ir — x) 


(n 2_p )2 withfc ^0,1,2,... 


2k sin 2 kir 2k sin &7T 


16 


£ with |6| < 1 


2 , 6 sin a; 

tan 1 
7r l — o cos a; 


17 


1 _ (-1)™ 

v 1 6™ with 161 < 1 

n 


2 , 26 sin x 

tai1 1 U2 
7T 1 — 6 2 
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Finite cosine transforms 



f c (n) = / F(x) cosnxdx, for n = 0, 1, 2, . . . . 
Jo 



No. 


/c(n) 


F{x) 


1 


(-l) n /c(n) 


F(ir - x) 




I 


7r n = 

n = l,2,... 


1 


3 




'0 n = 
2 . ri7r 

— sin — n = 1, 2, . . . 
In 2 


i 


1 forO < a; < tt/2 
-1 for7r/2 < x < tt 


4 




(-l)™-l/n 2 n = l,2,... 


a; 


5 




\*± ... 

k (-l)7« 2 n = l,2,... 


a; 2 
2tt 


6 




'0 n = 
^1/n 2 n = l,2,... 


( 


X — TT) 2 7T 

2tt 6 


7 


< 


T 

n 2 n 4 

[ 71=1,2,... 


X 3 


8 


(-l)"e c 7r - 1 
n 2 + c 2 


i 

c 




9 


1 

n 2 + c 2 


coshc(7r — x) 
c sinh C7r 


10 


- T A_ r [(-l)n C OS7rfc-l] 

n 2 — k 2 

with A; ^ 0,1,2,... 


sin kx 


11 


1 


'0 771 = 1,2,... 
/ iVn+m i 

^ — 771^1,2,... 

L 71^ — 77T 


1 

— sm rax 

771 


12 


1 

n 2 — k 2 

with A; ^ 0,1,2,... 




COSfc(7T — x) 

k sin kir 


13 


1 


7r/2 when n = m 
when n ^ to 


cos ma; (to = 1,2,...) 
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Fourier sine transforms 

/2~ roc 
— / f(x) sin(wa;) da;, cj > 0. 



No. 


/(*) 




1 


J 1 < a; < a 
If) r > a 


[2(1— coswa^ 

V 7T \ W / 


2 


a; 2 '" 1 (0 < p < 1) 


/TEM S in £ZL 


3 


1 sin a; < a; < a 
[0 a; > a 


1 /sin[a(l-u)] sin[a(l+w)] \ 


4 




l~2 ul 
\ ii 1 

y TT 1+lcH 


5 


xe -x 2 /2 


we— 2 /2 


6 


x 2 

COS 

2 


V2[sin^C/(^) 

-cos^s(^)] 


7 


a; 2 
sin — 
2 


V2[cos^C/(^) 

+ sin^s(^)] 



Fourier cosine transforms 

F(oj) = F c {f){w) = ^ J f{x) cos{wx) dx, w > 0. 



No. 


/(*) 


F(w) 


1 


Jl < x < a 


|2"sin aw 


1 a; > a 


V 7T U) 


2 


xP- 1 (0 < p < 1) 


flEM C0S £ZL 


3 


J cos a; < a; < a 
[0 a; > a 


1 sin[a(l— lj)] , sin[a(l+cj)] ^ 


4 


e -a; 


l~2 1 

V IT 1+U 2 


5 




e -^ 2 /2 


6 


x 2 

COS ^ 


COS - f ) 


7 


sm%- 


COS + f ) 
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Fourier transforms: functional relations 

F(co) = = 4= r f(x)e iux dx 

V 2ir J-oo 



No. 


fix) 


F(u) 


1 


ag(x) + bh(x) 


aG{uj) + bH{uj) 


2 


f(ax) a ^ 0, Im a = 


(a) 


3 


/(-*) 


F(-oj) 


4 


/(*) 


F(-oj) 


5 


f(x — t) Im r = 


e ioJT F{uj) 


6 


e iilx f(x) lmft = 


F{uj + Q) 


7 


F(x) 


/(-") 


8 


£-f(*) 


(-i£j) n F(£j) 


9 


(ix) n f(x) 




10 







Fourier transforms 

F(lo) = Hf){") = 4= /°° /(z)e^ ^ 



No. 


/(*) 




1 


S(x) 




2 


S(x — t) 




3 


S (n 1(x) 


{-iu) n l^ 


4 


H(x) = \ l X> ° 
[0 x < 




5 


s 


f 1 x > 
gn(x) = < 

1—1 a; < 




_[2_1_ 

V 7T icj 


6 




1 |x < a 
-1 |x| > a 


|2 sin aw 

V 7T CJ 


7 




e int \x\ < a 
\x\> a 




p2sma(Q + to) 
V 7T ft + w 


8 


e 


— a\x\ 


a > 


/i~ a 
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Fourier transforms 



FM = f(/)H = -l j 


/■OC 

—oo 


No. 


/(*) 


F(oj) 


9 


sin Qx 

X 


y/l [H(n-w) - H(-n-w)] 


10 


sin aa;/a; 


1 


\uj\>a 


1 1 
1 1 




e mx p < x < q 
x < p,x > q 


V27T 


12 




e -cx+iax x> q 

(c > 0) 

x < 


\/27r(w + a + «c) 


13 


e 


- p 3:2 Re p > 


^_ -co 2 /4p 


14 


cos pa; 2 


^cos(g-f) 


15 


sin px 2 


^ cos (£ + ?) 


16 


\x\~ p (0 < p < 1) 


RV(l-p) sin^ 


17 


e 




Vw 2 +a 2 


18 


cosh as (- < < \ 
coshTrz V ' 


/2 cos ^ cosh y 
y 7r cos a+cosh cj 


19 


"j"*"' ( 7T < a < tt) 




1 sin a 


sinh 7r;z v y 


/2tt cos a+cosh u 


20 


< 


\x\>a 


,/f J (aw) 


21 


sin[bVa 2 + x' 2 ] 


1 


\ui\>b 


Va 2 + x 2 


yHLJ^V -^) \oj\<b 


22 


< 


f p n (x) \x\<l 
|z| > 1 


^•4+1/2^) 


23 


< 


f cosf&Va 2 — iC 2 l 1 1 - 

1 ^z? W <« 
k |x|>a 


^/f Jo(aVa; 2 + fo 2 ) 


24 


< 


f cosh^Va 2 -^ 2 ] I I „ 

^0 |x|>a 


^/f Jo(aVa; 2 -fo 2 ) 
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Multidimensional Fourier transforms 







F(u) = (27r)-«/ 2 

R" 


/ /(x)e !; ( x - u ) dx 


No. 


/(x) 


F(n) 


In n -dimensions 


1 


/(ax) Im a = 




2 


/(x-a) 


e- ia -"F(u) 


3 


e 


«,x /(x) 


F(u + a) 


4 




(2tt)"/(-u) 


Two dimensions: let x = (x, y) and u = (u, v). 


5 


/(aa;,fa/) 


|afo| Va'6/ 


6 


/(a; -a,y -b) 


e i ( au+6 ")F(u 1 ?;) 


7 


e 


i ( ax+b v^f(x,y) 


F(u + a,v + b) 


8 


F(x,y) 


(2tt) 2 F(-u,-v) 


9 


S(x — a)S(y — b) 


— i(au-\-bv) 


10 


e 


-x 2 /4a- y z/4b a,b > 


2 v / a6e- a " 2 -^ 2 


11 




1 \x\<a,\y\<b / 

11 m (rectangle) 
otherwise 


2 sin aw sin few 

TTUV 


12 




1 \x\ < a 

. (strip) 
otherwise 


2 sin au , . 
6{v) 

TTUV 


13 




1 x 2 + y 2 < a 2 

(circle) 

otherwise 


aJ\ (a\/u 2 + v 2 ) 
\/u 2 + V 2 


Three dimensions: let x = (x, y, z) and u = (u,v,w). 


14 


S(x — a)S(y — b)S(z — c) 


^ —i(au+bv+cw) 


(2tt) 3 / 2 


15 


e 


-x 2 /4a-y 2 /4b-z 2 /4c a ^ c > Q 


2 3 / 2 Vabce- au2 - bv2 - cw2 


16 


\ 


1 \x\ < a, \y\ < b, \z\ < c 
otherwise (box) 


f 2 ^ 3 ^ 2 sin aw sin fa; sin cw 
\7T/ www 


17 


\ 


fl x 2 + y 2 + z 2 <a 2 (baU) 
otherwise 


sinap — ap cos ap 

V27TP 3 

p 2 = u 2 +v 2 + w 2 
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Laplace transforms: functional relations 

POO 

F(s) = C(f)(s) = / f{t)e- st dt. 
Jo 



No. 


/(*) 


F( S ) 


1 


a/(t) + bg(t) 


aF(s) + bG(s) 


2 


/'(*) 


sF(s) - F(0+) 


3 


/"(*) 


i—i / \ i—i / r\ . \ 1—1/ / i~\ , \ 

s 2 F(s) - sF(0+) - F'(0+) 


4 




n-l 

s n F(s) _^ s »-i-*fW(o + ) 

A;— 


5 


/o/Wdr 




6 


Jo Jo" f(u)dudr 




7 


llh{t-T)h{r)dT = h*h 


F 1 (s)F 2 (s) 


8 


*/(*) 


-F'(s) 


9 


*"/(*) 


(-l)"F(")(s) 


10 






11 




F(s - a) 


12 


/(*-&) with/0) =0fori<0 




1 J 






14 




-T ^CS — 0) 


15 


/(t + a) = /(t) 


J Q a e- st f(t)dt/l-e- as 


16 


/(t + a) = -/(*) 


Jo e- st f(t)dt/l + e- as 


17 


V^n p(a») _ait 

with qi(i) = (i — ai) • • • (t — a„) 


p(s) 


18 




<P(s) 




(s -a) n 
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Laplace transforms 

POO 

F(s) = £(/)(«) = / f(t)e- st dt. 
Jo 



No. 


/(*) 


F( S ) 


1 


6(t), delta function 


1 


2 


H(t) , unit step function or 
Heaviside function 


l/s 


3 


t 


l/s 2 


4 


(n-l)! 


l/s" (n = l,2,...) 


5 






6 


2 v / i77r 


g-3/2 


7 


2 „ r -l/2 

V^r(2n-1)!! 


s-(™ +1 / 2 ) (n = l,2,...) 


8 




^ (* > 0) 


9 




i 

s — a 


10 


te at 


1 

(s-a) 2 


11 


1 -m — l^ai 
(n-l)! 1 e 


T^ar (" = i,2,...) 


12 


f *-l e at 


(*>o) 


13 


^ " «") 


(«-aK«-fc) (« ^ 6 ) 


14 


^ (ae ai - 6e M ) 


(.-<.)%-») (° ^ 6 ) 


15 


(b-c)e at + (c-a)e ht + (a-b)e" t 




(a—b)(b—c)(c—a) 


( S _a)(.i»)(.- C ) (a, M distinct) 


16 


- sin ai 

a 


1 

s 2 + a 2 


17 


cos at 


s 2 + a 2 


18 


- sinh at 

a 


1 

s 2 — a 2 


19 


cosh erf 


s 

s 2 -a 2 


20 


^■(1 — cos at) 


1 

s(s 2 +a 2 ) 


21 


^3 (erf — sin at) 


1 

s 2 (s 2 + a 2 ) 


22 


2^3 (sin at — at cos erf) 


1 

(s 2 + a 2 ) 2 


23 


4a S ^ n a * 


(s 2 + a 2 ) 2 
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Laplace transforms 

POO 

F(s) = £(/)(«) = / f(t)e- st dt. 
Jo 



No. 


/(*) 




24 


(sin at + at cos at) 


(s s +a ! ) J 


25 


t cos at 


s 2 -a 2 
(s 2 + a 2 ) 2 


26 


cos at — cos bt 


( s 2 + a 2 )( s 2 +6 2 ) ( a ) 


27 


je at sin bt 


1 

(s-a) 2 + 6 2 


28 


e at cos bt 


s— a 
(s-a) 2 + b 2 


29 


e~ at /2n-A-l\ 
4n -i b 2„ 2_k=\ \ „_i J 

x (-2^-^ [cos fa] 


1 

[(a - a) 2 + 6 2 ]" 


30 


e~°* / /2n-fc-l\ (-2i) t! - 1 
4 n-i^n | 2-,*=l I n -l I (k-l)i 

x [a cos bt + b sin af] 

OJ-V^™- 1 (2n-k-2\ (-2t) h ~ 1 
zo 2^k=l \ n-l J (A-l)! 

x ^ [sin bt] | 


s 

[(s - a) 2 + 6 2 ]™ 


31 


e at 

„at/2 ( „„„ atV3 ,/q„;„ aiv^ 

— e ' I cos — j v>3Sin — 2 J 


3a 2 
s 3 + a 3 


32 


sin ai cosh ai — cos ai sinh ai 


4a 3 
s 4 +4a 4 


33 


^ sin at sinh ai 

2a 2 


s 

s 4 +4a 4 


34 


2^3 (sinh ai — sin at) 


1 

s 4 -a 4 


35 


2^2 (cosh at — cos at) 


s 4 -a 4 


36 


(1 + a 2 £ 2 ) sin at — cos at 


8aV 
(s 2 + a 2 ) 3 


37 


n! dt" V 1 e J 




38 


^e-(l+2at) 


(s-a) 3 / 2 


39 


1 ( r bt r at\ 
2V^F l J 


— a — \/s — b 


40 


_^_ ae a 2 terfc(av / i) 


1 


41 


_^ +ae a 2 t er f(av / i) 


V? 
5 — a 2 
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Laplace transforms 

POO 

F(s) = £(/)(«) = / f(t)e- st dt. 
Jo 



No. 


/(*) 


F(s) 


42 






43 


I a 2 i „ t /f\ 


1 

Vs(s-a 2 ) 


44 


_2_ -a 2 t f"Vt T i , 


1 

V^(«+« 2 ) 


45 


e a2t [b - aerf(aVi)] 
-be 6 * erfc(bVi) 


b 2 - a 2 


46 


.pCt i OT^Y" 1 ( ft \ / t\ 


1 

v / «(v^'+ a ) 


47 




1 


48 


a 2 t \b er f( ax /f) _ 1] 

+e 62 * erfc(b v / i) 


& 2 — a 2 
V^(s-a 2 )(v^+'>) 


49 


(2n)! ! v^ jff2 " (v/ * ) 


(1-.)" 

S« + l/2 


50 


(2n+l)!v^ jff2 ™+ 1 ( v/ *) 


(1-.)" 
s n + 3/2 


51 


ae" ai [7i(ai) + 7 (a*)] 




52 


e-( a+6 )'/ 2 7 (^t) 


1 


53 


/ \k-l/2 , x , 
(_^) c -(a + »)*/ a 

X 4-l/2 (hT^) 


r(fc) ^ 

(s + a)*(s + b)* 1 " J 


54 


te -(a+b)t/2 [ 7q (a^) 


1 


55 


±e-°'Ji(at) 


V5+2a — 


56 


Jo (at) 


1 

VV+a 2 


57 


a k Jk(at) 


'■^m^- * > -» 


58 


r§j (^)* V2 -4-1/2 (a*) 


(s 2 +a 2 )l! (k > 0) 


59 


^Jk(at) 


(Vs 2 + a 2 - s) fc (fc > 0) 


60 


a k h(at) 


i^gEgL (k > -l) 


61 


r§j ihf 1/2 4-1/2 (^) 


( s 2_ a 2)i, (fc > 0) 
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Laplace transforms 

POO 

F(s) = £(/)(«) = / f(t)e- st dt. 
Jo 



No. 


/(*) 


F( S ) 


LIZ, 




when < t < k 

1 when t > k 


s 


63 




when < t < k 
t — k when t > k 


S 2 


64 


1 


when < t < k 
(f rfo)" 1 when 1 > k 


p & s 

yj > uj 


65 


1 


1 when < t < k 
when t > k 


1 - e~ ks 
s 


66 


sin at\ 


a rnth 18 
s 2 +a 2 COtn 2a 


67 


J (2^) 


I„-a/s 


68 


— ?= cos2\/crf 


J_ e -a/s 


69 


— }= cosh 2\/crf 


J_ e a/s 


70 




-}= sin 2\fai 


1 r -a/s 

s 3/2 V 


71 




-j= sinh 2\/ai 




72 


(i) (fc - 1)/2 J,_ 1 (2 v ^) 


^e" a / s (fc > 0) 


73 


(i) ( - 1)/2 7,_ l( 2v^) 


4re a/s (fc > 0) 


74 


5 


a „-a 2 /4i 


e" a ^ ( a > 0) 


75 


erfc fe) 


I e - a V? ( a > 0) 

s v — ' 


76 


_J_ p -a 2 /At 


-±= e - a ^~ s (a > 0) 


77 


2 


yi e -aV«_ aerfc (_Oj) 


s -3/2 e -av^ ( a > 0) 


78 


e 


afc+a 2 * erfc ^ av ^ + _A_ j 


rtTr, (* > 0) 


79 


J (aVt 2 +2kt) 


■ " <*f» 


80 


r'(i)-io g t 


7 logs 


81 




fe— i [ r'(*) io g il 
jr(*)| u r(*)_ 


^logs (fc>0) 


82 


e 


ai [loga - Ei(-ai)] 


7?f («>°) 
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Laplace transforms 

POO 

F(s) = £(/)(«) = / f(t)e- st dt. 
Jo 



No. 


/(*) 


F(s) 


83 


cosiSi(i) - siniCi(i) 


logs 
s 2 + l 


84 


-siniSi(i) - cosiCi(i) 


t log 5 


85 


-Ei(-f) 


i log(l + as) (a > 0) 


86 


i(e w - e at ) 




87 


-2Ci(-i) 


Mog(l + a 2 s 2 ) 


88 


2 log a - 2 Ci(ai) 


Mog(s 2 +a 2 ) (a>0) 


89 


| [at log a + sin at — at Ci(ai)] 


4,log(s 2 +a 2 ) (a>0) 


90 


|(1 — cosai) 


2 i 2 

log^ 


91 


|(1 - cosh erf) 


log^i 


92 


| sin erf 


tan" 1 ^ 

s 


93 


1 e -* 2 /4a 2 


e a 2 s 2 er f c ( as ) ( a > 0) 


94 




±e aV erfc (as) (a > 0) 


95 


irVt(t+a) 


e as erfc( v / as) (a > 0) 


96 


1 

v^(i+a) 


-^e as erfc (-y/as) (a > 0) 


97 


wt »inv za V 


prf 1 -2-1 


98 


1 

t+a 


-e as Ei(-as) (a > 0) 


99 


1 

(i+a) 2 


i + se as Ei(-as) (a > 0) 


100 


1 


[f — Si(s)] coss + Ci(s) sins 


101 


Jo when0<i<a 
\(t 2 - a 2 )' 1 / 2 wheni > a 


K (as) 
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Hankel transforms 

POO 

K v {f){y) = F Av) = / f(x)^yJ v (yx) dx, y > 0. 



No. 


/(*) 




1 


Ja;^ 1 / 2 , 0<a;<l 
\o, Kx 

p£» 7/ \ 1 


— 1/2 t / ^ 


2 


[x^ l l 2 {a 2 -x 2 Y, 0<x<a 
1 0, a < x 

IXC //, IXC jj, ^ I_ 


2"r(^ + i)o"+'' +1 i/-''- 1 / 2 

x J v +n+i (ay) 


3 


^+1/2^2 +a 2 ) -,-l/2 ! 


^ y u-\/2 2 -u e -a V 




Rea>0, Rei/>-l/2 


x [r^ + 1/2)]" 1 


/i 
4 


a ,!^+l/2g-aa; 


a(7r)- 1 / 2 2"+ 1 ^+ 1 /2r( I / + 3/2) 




Re a > 0, Re i/ > -1 


x (a 2 +y 2 )— 3 / 2 


c 


a ,y+l/2 e -aa: 2 ! 

Re a > 0, Re i/ > -1 


y T ' (zaj exp l—y /4aJ 


6 


e~ ax l\fx, 


^-^+1/2 [^( a 2 +J/ 2) _ a ] 




Re a > 0, Re i/ > -1 


x ( 2 , „2W/2 


7 


x -v-l/2 CQS ( ax ^ 


V?2-^-+ 1 /2[r( I / + i/2)]- 1 




a > 0, Rei/>-l/2 


x (y 2 - a 2 )"" 1 / 2 ^ (y - a) 


8 


x i/2-f s i n ( aa; ) j 


a2 1 -" v ^F^+ 1 /2[r( I /- 1/2)]" 1 




a>0, Rei/>l/2 


x (y 2 - a 2 y- 3 / 2 H(y - a) 


9 


a; -1 / 2 J„_i(ax), 

a > 0, Re v > -1 


a u-\ y -u+\/2 H ^ y _ a ) 


10 


a; -1 / 2 J„ + i(ax), 

a > 0, Rei/>-3/2 


jo, a<j/ 
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Hilbert transforms 









= F(y) = - 




No 


/(*) 


^ 12/ J 


1 


1 





2 


< 


0, —oo < x < a 

1, a < x < b 
0, b < x < oo 


-log (6- y)(a -y)" 1 

7T 1 1 


s> 


1 


0, —oo < a; < a 
x~ l , a < x < oo 


(7ry) _1 log a(a-iy)- 1 , 

O^y^a, a>0 


4 


(x + a)" 1 


Ima > 


i(y + a) -1 


C 

J 




1 




y 


1 + x 2 




i + y 2 







1 




2/(1+ 2/ 2 ) 




1 + x 4 




v^l+2/ 4 ) 


7 


sin(ax), 


a > 


cos(ay) 


O 


sin(ax) 


a > 


cos(ay) — 1 


o 






2/ 


Q 

y 




sinx 




cosy — e _1 


1 + x 2 




l+y 2 


10 


cos(ax), 


a > 


- sin(ay) 


11 


1 — cos(ax) 

X 


a > 


sin(ay) 

y 


12 


sgn(a;) sin(a|x| 1 / 2 ) 


a > 


cos(a|y| 1 / 2 ) + exp(-a|y| 1 / 2 ) 


13 


e 




a > 


ie iay 
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Mellin transforms 

POO 

r(s) = M[f(x);s}= / f(x)x s - 1 dx. 



No. 


fix) 


f*(s) 


1 


ag(x) + bh(x) 


ag*(s) +bh*(s) 


2 


f (n \x)\ 


(-i)"rgV>-») 


3 


x n f( n \x)\ 


( _ 1) „rtol r(s) 


4 


Inf(x)\ 


(-i)"rgfe/-(- + ") 


5 


e -x 


r(s) Re s > 


6 


e -x 


^r(is) Res>0 


7 


COSX 


r(s)cos(±7rs) 0<Res<l 


O 
O 


sin x 


1 ^sj sm^Trsj u < s < i 


9 




7rcot(7rs) < Re s < 1 


10 


(1 + x)- 1 


7r cosec(7rs) < Re s < 1 


11 


(l + x a )- b 


r(>MW->/*) 0<Res<ab 


12 


log(l + ax) arg a < tt 


Trs~ 1 a~ s cosec(7rs) 

- 1 < Re s < 


13 


tan -1 x 


- 1 < Re s < 


it 


cot ^ X 


2"7T.S SeC^TTSJ U <. Kc S <. 1 


15 


csch aa; Re a > 


2(1 - 2- s )a- s T(s)C(s)Re s > 1 


16 


sech 2 ax Re a > 


4(2a)- s T(s)C(s - 1) Re s > 2 


17 


csch 2 ax Re a > 


4(2a)- s r(s)C(s - 1) Re s > 2 


18 


K v {ax) 


a -*2*-2r(( s -z/)/2) 
xr((s + i/)/2) Res>|Rei/| 



fAssuming that \im x ^ 0+ x s r 1 (a;) = for r = 0, 1, . . . , n — 1. 

fWhere I n denotes the n th repeated integral of f(x): lof(x) = f(x), I n f(x) 
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5.1 DIFFERENTIAL CALCULUS 



5.1.1 LIMITS 

If lim f(x) = A < oo and lim g(x) = B < oo then 

x— va x—^a 

1. lim (f(x) ± g{x)) = A ± B 

x—ta 

2. lim f(x)g(x) = AB 

x—ta 

3. lim 44 = 4 (if 5*0) 

4. lim [f(x)] 9(x) = A B (if A > 0) 

X— Yd 

5. lim h(f(x)) = h(A) (if h continuous) 

6. If /(a;) < g(x),thenA < B 

7. If A = B and f(x) < h(x) < g(x), then lim h(x) = A 
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EXAMPLES 

/ t\ x , , ,. sinax 

1. lim 1 + - = e 5. hm 



X^rOO \ X ) X ~>° X 

2. lim x 1/x = 1 6 i im a Z 1 = w a 



4. lim ai p |log2!| 9 = 0(ifp>0) 

x— >0-\- 



x->0 X 



3. lim M^! = (ifg>0) log(l + s) 



z->0 



5.1.2 DERIVATIVES 

The derivative of the function f(x), written f'(x), is de ned as 
v ' Az^o Aa; 



(5.1.1) 



if the limit exists. If y = f(x), then ^| = f'{x). The n th derivative is 



(n) = dy (n -^ = d_ f d n ~ l y 
dx dx \ dx n ~ l 



d n y 
dx™ 



f (n) (x). 



The second and third derivatives are usually written as y" and y'" . Sometimes the 
fourth and fth derivatives are written as y( ,v ) and y^ . 

The partial derivative of f(x,y) with respect to x, written f x (x,y) or |£, is 
de ned as 

t i x r f(x + Ax,y) - f(x,y) 
Jx(x,y) = hm — . (5.1.2) 



Aa; 



5.1 .3 DERIVATIVES OF COMMON FUNCTIONS 

Let a be a constant. 



fix) 



fix) 



fix) 



fix) 



fix) 



fix) 



SIM 
COS X 

tan x 
cscx 
secx 
cotx 
sin -1 x 
cos -1 x 
tan -1 x 
esc -1 x 
sec -1 a; 
cot -1 x 



cos a; 

— sin a; 
sec 2 x 

— esc a; cot x 
sec x tan x 

— esc 2 a; 

l 

l 



l 



l 

1 



xy/x' 2 — 1 
1 



sinha; 
cosh a; 
tanh a; 
csch a; 
sech a; 
coth a; 
sinh -1 a; 
cosh -1 x 
tanh -1 x 
csch -1 x 
sech -1 x 
coth -1 x 



cosh a; 

sinha; 

sech 2 x 

csch x coth x 

sech x tanh x 

— csch 2 a; 
i 

i 

Vx~ 2 ~=T 
l 

-l 



I^IVi+a; 2 
-l 

1 



ttj: 



a-1 



\fx 
ln|a;| 

a 31 (a > 0) a x In a 



l 

1/x 



1-z 2 



© 2003 by CRC Press LLC 



5.1.4 DERIVATIVE FORMULAE 



Let u, v, w be functions of x, and let a, c, and n be constants. Appropriate non-zero 
values, differentiability, and invertability are assumed. 

(a) ± (a) = (b) ^(x) = l 

dx dx 

d . . du d , . du dv 

(c) — (au) = a— (d) — (u + v) = — + — 

dx dx dx dx dx 

d t . du dv d . . dw dw 

(e) — (iwj = t; — — h m— (f) — (uvw) = uv — — \-uw— — \-vw — 

dx dx dx dx dx dx dx 

1 du u dv v(du/dx) — u(dv/dx) 



d /u\ i du u dv 
^ dx \v / w dx v 2 dx 



V 2 






d 

dx 


(«") 


v-l du 

= vu — 
dx 


d 

dx 


(!og e 


^ 1 du 

u dx 


d 




1 du 


dx 


(=) 


u 2 dx 


d 


/«" 




dx 


\v m 


j v m+l 



(h) A ( u ») = nu™" 1 ^ (i) («") = W" 1 ^ + (log e u)u v ^ 

da; dx dx dx dx 

^ da; ^- v ^ 2i/u da; ^ 

d x x 1 du 

(l)-(l g a .) = (l 0ga e)-- (m) 

d / 1 \ n du d ( u n \ u n ~ Y ( du dv 

( n ) "i - I ~ r I = — rrr^ - (o) -V — = rr raw- mu — 

dx \u n u n+1 dx dx\v m v m+1 \ dx dx 



(p) A („•>„•») = u — C nu ^ + TOU ^ 

da; \ da; da; 

, s d , „, d/ , . dw 

(r) -r^ / « = -f u ' "TT + TT u ' "T 

dar aw dar dir \da; y 

d™ /n\ d"w /n\dvd n ~ 1 u fn\d n v 

dx" \0J V dx" {ljdxdx"- 1 \n)dx" U 



(0 



f /« * = /(*) (u) f /(t) dt = -/(a;) 

dx j c dx j x 



da; d / ( ^ 

dy \dx J dy 2 dx 2 j \dx 
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dn F 

(w) TfF(x,y) = 0, then -f- = and 

dx F y 

cPy_ (Fx X F 2 -2F xy F x F y +F yy F 2 ) 
dx 2 Fjj 

(x) Leibniz's rule gives the derivative of an integral: 



A ( ra(x) \ rg(x) gu 

/ h(x,t)dt) =g'(x)h(x,g(x))-f(x)h(x,f(x))+ / ^(x,t) 
ax \Jf( x ) J Jf( x ) ox 



dt. 



(y) If x = x(t) and y = y(t) then (the dots denote differentiation with respect to t): 

dy_ = y(t)_ (fy = xy - xy 

dx x(t) ' dx 2 (x) 3 



5.1.5 DERIVATIVE THEOREMS 

1. Fundamental theorem of calculus: Suppose / is continuous on [a, b]. 

r 

(a) If G is de ne d as G(x) = / f(t) dt for all x in [a, b], then G is an 

J a 

antiderivative of / on [a, b]. 

(b) If F is any antiderivative of /, then / f(t) dt = F(b) - F(a). (Recall 

J a 

that J a f(x) dx is de ned as a limit of Riemann sums.) 

2. Intermediate value theorem: If f(x) is continuous on [a, b] and if /(a) ^ 
f(b), then / takes on every value between /(a) and f(b) in the interval (a, b). 

3. Rolle's theorem: If f(x) is continuous on [a, b] and differentiable on (a, b), 
and if /(a) = /(&), then /'(c) = for at least one number c in (a, b). 

4. Mean value theorem: If f(x) is continuous on [a, b] and differentiable on 
(a, b), then a number c exists in (a, 6) such that f(b) — f(a) = (b — a)f'(c). 



5.1 .6 THE TWO-DIMENSIONAL CHAIN RULE 

If x = x(t), y = y(t), and z = z(x, y), then 

dz dz dx dz dy 
dt dx dt dy dt ' 
S^_dz_Sx_ dx/d^dx d 2 z dy\ 
d¥ ~ dx~~d¥ + -j£ \jw~dt + dxdy dt ) 

dz d 2 y dy (d 2 zdy d 2 z dx\ 
+ dy~~d¥ + ~dt [dy^di + dxdy ~dt ) ' 
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If x = x(u, v), y = y(u, v), and z = z(x, y), then 

dz dz dx ^ dz dy ^ dz dz dx ^ dz dy ^ 

du dx du dy du dv dx dv dy dv 

If u = u(x,y), v = v(x,y), and / = f(x,y), then the partial derivative of / 
with respect to u, holding v constant, written (§f ) > can be expressed as 



5.1.7 L'HOSPITAL'S RULE 

If f(x) and g(x) are differentiable in the neighborhood of point a, and if f(x) and 
g(x) both tend to or oo as x — > a, then 

Hm M = lim (5.1.6) 

x^a g[x) x-Hi g'(x) 

if the right hand side exists. 
EXAMPLES 

.. x — sinx ,. 1 — cosx ,. sinx ,. cosx 1 
hm = hm = hm = hm = — , 

x^o x s z->o 3x x^o 6x z->o 6 6 

,. x n ,. m"" 1 ,. n(n-l)x n - 2 ,. n\ „ 

hm — = hm = hm = ■ ■ ■ = hm — = U. 

x— foo e x x— foo e x x— >oo e x foo e x 

5.1 .8 MAXIMA AND MINIMA OF FUNCTIONS 

1. If a function f(x) has a local extremum at a number c, then either / '(c) = 
or /' (c) does not exist. 

2. If /'(c) = 0, /(a;) is differentiable on an open interval containing c, and 

(a) if /"(c) < 0, then / has a local maximum at c; 

(b) if /"(c) > 0, then / has a local minimum at c. 



5.1.8.1 Lagrange multipliers 

To nd the extreme values of the function f(xi,X2,---,x„) = /(x) subject to the 
m side constraints g(x) = 0, introduce an m-dimensional vector of Lagrange mul- 
tipliers A and de ne F(x, A) = /(x) + A T g(x). Then the extreme values of F with 
respect to all of its arguments are found by solving: 

dF df T dz dF 

dx- = di +x d^ = > and dy =gj = - (5 - L7) 

For the extreme values of f(x, y) subject to g(x, y) = (i.e., n = 2 and m = 1): 

fx + Xg x =0, f y + Xg y = 0, and g = 0. (5.1.8) 
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EXAMPLE To nd the points on the unit circle (given by g(x,y) = (x — l) 2 + (y — 
2) 2 - 1 = 0) that are closest and furthest from the origin (the distance squared from 
the origin is f(x, y) = x 2 + y 2 ) can be determined by solving the three (non-linear) 
algebraic equations: 

2x + 2\{x - 1) = 0, 2y + 2\{y - 2) = 0, (x - if + {y - 2) 2 = 1. 

The solutions are x = 1 + l/y/5,y = 2 + 2/a/5, A = -1 - a/5 (furthest), and 
x = 1 - 1/VE, y = 2- 2/y/E, X = y/E - 1 (closest). 



5.1.9 VECTOR CALCULUS 

1. De nition s of "div", "grad", and "curl" are on page 493. 

2. A vector eld F is irrotational if V x F = 0. A vector eld F is solenoidal if 
V-F = 0. 

3. In Cartesian coordinates, V = {j^,-j^,§^ = + + k^. If u and v 
are scalars and F and G are vectors in E 3 , then 

\7(u + v) = Vu + Vv, 

V{uv) = «Vt) + tiVu, 
V(F + G) = VF + VG, 
V(F • G) = (F • V)G + (G • V)F + F x (V x G) + G x (V x F), 
V • (uF) = u(V • F) + F • Vu, 

V • (F x G) = G • (V x F) - F • (V x G), 

V x (uF) = u(V x F) + (Vu) x F, 
Vx(F + G)=VxF + VxG 

V x (F x G) = F(V • G) - G(V • F) + (G • V)F - (F • V)G, 

F.^ = |F|^1 
dt 11 dt ' 

V x (V x F) = V(V • F) - V 2 F, 

V x (Vu) = 0, 

V • (V x F) = 0, and 

V 2 (w) = tiV 2 ti + 2(Vu) • (Vu) + tiV 2 «. 

Note that V • u = ^Li ^7 is a scalar while F • V = ^Li ^sf" is an 
operator. 

4. If r = |r|, a is a constant vector, and n is an integer, then 





V$ 


V 2 $ 


a • r 

r n 

logr 


a 

nr" _2 r 
r/r 2 




n(n + l)r"~ 2 
1/r 2 
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F 


VF 


V x F 


(G • V)F 


r 


3 





G 


a x r 





2a 


a x G 


ar n 


nr n " 2 (r-a) 


nr n ~ 2 (r x a) 


nr n " 2 (r-G)a 


rr n 


(n + 3)r n 
r • a/r 2 





r n G + nr n " 2 (r-G)r 


a log r 


r x a/r 2 


(G • r)a/r 2 



F 


V 2 F 


VVF 


r 

a x r 

ar n 
rr n 
a log r 





n(n + l)r n_2 a 
n(n + 3)r n_2 r 
a/r 2 





nr n_2 a + n(n - 2)r n_4 (r • a)r 
n(n + 3)r n_2 r 
[r 2 a - 2(r • a)r]/r 4 



d_ 

dt, 



(F + G) 



d_ 

dt, 



(F-G) 



- (V! x V 2 x V 3 ) 
dt 



^[V lV2 V3] 



^ ciG 

li + ~dt' 

^ dG d¥ „ 
- F • — — h — • G, 

dG dF 



(F x G) = F x — + — x G, 



dt dt 
^f) x (V 2 xV 3 )+Vi x 



dV 3 
dt 

Vi 



+ Vi x j V 2 x 

dVi 
~dT 



v 2 v 3 



+ 



dV 2 
di 



dV 2 
dt 



+ 



x V, 



ViV 2 



dV 3 ' 
dt 



where [Vi V 2 V 3 ] = Vi • (V 2 x V 3 ) is the scalar triple product (see page 136). 



5.1.10 MATRIX AND VECTOR DERIVATIVES 
5.1.10.1 De nitions 



1 . The derivative of the row vector y 
scalar x is 



<9y 

dx 



dyi 
dx 



9y2 
dx 



[yi 2/2 • • • y m ] with respect to the 

dyn 



dx 



2. The derivative of a scalar y with respect to the vector x is 



(5.1.9) 



dy 
dx 



dy 

8X2 



dy 



(5.1.10) 
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3. Let x be a n x 1 vector and let y be a to x 1 vector. The derivative of y with 
respect to x is the matrix 



dy 
dx 



dm 


9y2 


9y m 


9xi 


9xi 


9xi 


9yi 


9y2 


9y m 


9X2 


3X2 


9X2 


9yi 


9y2 


9y m 




dx n 


9x n 



(5.1.11) 



In multivariate analysis, if x and y have the same dimension, then the absolute 
value of the determinant of || is called the Jacobian of the transformation 
determined by y = y(x), written ^(3/1,3/2, ■■■,;/„) . 

J J K f 9{Xl ,X2,---,X n ) 



4. The Jacobian of the derivatives ... fg- of the function (f>(x 1 , x n ) 

with respect to x\ , . . . , x n is called the Hessian H of (f>: 



H 



9x\ 
9 2 d> 



9x2 9xi 



yxi 6x2 9xi dxs 
9 2 <p 9 2 <p 
9x'i 9x2 9x3 



yxi dXn 
9 2 <t> 



5. The derivative of the matrix A(t) = (a,j(i)), with respect to the scalar t, is the 



matrix 



dA(t) 
dt 



6. If X = (xij) is a to x n matrix and if y is a scalar function of X, then the 
derivative of y with respect to X is (here, By = e,e j): 





' 9y 


9y 


9y ' 




9xn 
9y 


9X12 

9y 


9xi n 

9y 


dy 


9X21 


9X22 


9X2n 


dX 










9y 


9y 


9y 




_ 9Xml 


9x m 2 


9x m n _ 



l<i<m 
l<j<n 



dy 



(5.1.12) 



7. If Y = (yij) is a p x q matrix and X is a to x n matrix, then the derivative of 
Y with respect to X is 



dY 
dX 



■ dY dY 
9xii 9xi2 
9Y_ 

JX22 



9^21 



OY dY 



9Y 

9X2n 

9Y 



yx m i OX m 2 



E 

l<i<m 
l<j<n 



dY 

Ox a 



(5.1.13) 
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5.1.10.2 Properties 



y (a scalar or a vector) 


|| (recall, x is a vector) 


x T 


/ 


Ax 


A T 


x T A 


A 


T 
XX 


2x 


x T Ax 


Ax + A r x 



(with A constant) 

dAx _ a 
9x T _ A 



y (a scalar, vector, or matrix) 


(recall, X is a matrix) 


YZ 


\r dZ | dY y 


AXB 




a 1 X T Xb 


X(ab T + ba T ) 


a T I T Xa 


2Xaa T 


a T X T CXb 


C T Xab T + CXba T 


a T X T CXa 


(C + C T )Xaa T 


(Xa + b) T C(Xa + b) 


(C + C T )(Xa + b)a T 


tr(X) 


7 


tr(A T X), tr(XA T ), tr(AX T ), or tr(X T A) 




tr(XAX T ) 


X T (A + A T ) 


tr(X T AX) 


(A + A T )X 


tr(X T AXB) 


AXB + j4 t JB t 


det(X) ordet(X T ) 


det(X)(X" 1 ) T 


log | A" | 


(X"T 



3. 



(with {a, b, A, B} constants, Y = Y(X), and Z = Z(X)) 



4. 



y (a scalar, vector, or matrix) -ft (here t is a scalar) 



AS 
A® B 
A- 1 



<£®B + A®«§ 

_ AdA_A-\ 

A dt A 



(with A = A(t) and B = B{t)) 
5. IfY = AX' 1 B, then 

( a > £7, = -AX-'ErsX-'B. 

(b ) = -(A-^EyS^" 1 )* 
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6. If Y = AXB then = AE^B where Eij = e,ej has the same size as X. 

7. If Y = AX T B, then ^ = BEjjA. 

8. If Y = X T AX, then 

(a) £-=Ej s AX+X T AE rs . 

(b) = AXEjj + A T XEij. 

9. If y = Vec Y and x = Vec X (see page 158), then 

(a) If Y = AX, then ff = 7 ® A T . 

(b) If y = XA, then ff = A ® 7. 

(c) If y = AX then §f = -(X^S) ® (X- 1 ) T A T . 

10. The derivative of the determinant of a matrix can be written: 

(a) Ify^ is the cofactor of element i/y in | K | , then g = £. hItt- 

(b) If all the components ofX are independent, then ^jp- = |X| (X _1 ) T . 

11. Derivatives of powers of matrices are obtained as follows: 

(a) If y = A"', then ■§*- = J2Zl X k E rs X n ~ k -\ 

(b) If y = X" r ,then -jg- = -X~ r (j2l^o X k E rs X n ~ k - 1 ) X" r . 

(c) The n th derivative of the r th power of the matrix A -1 , in terms of deriva- 
tives of the matrix A, is 

d " A ~' i\ | V(-1)*?t?t • • • tt I (5.1.14) 

where "P, = A~ r ^~- and the summation is taken over all positive in- 
tegers {i\,i2, ■ ■ ■ ,ik), distinct or otherwise, such that Ylm=i * m = n - 
Setting n = r = 1 results in 



d 4^ = -A~^A-\ (5.1.15) 
dx dx 

12. Derivative formulae: 

dx Ox <9x 

(a) Ifz = z(y(x)),then- = --. 

(b) If X and Y are matrices, then (f|-) T = f^. 

(c) If X, y, and Z are matrices of size m x n, n x v, and p x q, then 

^ = !f(^) + (^)§F 
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5.2 DIFFERENTIAL FORMS 



De ne dxk(-) to be the function that assigns a vector its k th coordinate; that is, for 
the vector a = (ai , . . . , a& , . . . , a„) , we have dxu (a) = au ■ Geometrically, dxu (a) 
is the length, with appropriate sign, of the projection of a on the k th coordinate 
axis. When the {Fi} are functions, the following linear combination of the functions 
{dx k } 

w x = Fi(x) cfoi + F 2 (x) dx-2 H + F n (x) dx n (5.2.1) 

produces a new function u x . This function acts on vectors a as 

cjx(a) = Fi (x) dx! (a) + F 2 (x) dx 2 (a) + • • • + F n (x) dx n (a) . (5.2.2) 

Such a function is a differential 1-form or a 1-form. For example: 

1. If a = (-2,0,4) thencfa;i(a) = -2, dx 2 {&) = 0, and£fo 3 (a) = 4. 

2. If in K 2 , w x = w^j,) = x 2 dx + y 2 dy, then uj( x ^{a,b) = ax 2 + by 2 and 
^(1^3) (a, b) = a + 9b. 

3. If /(x) is a differentiable function, then V x /, the differential of / at x, is a 
1-form. Note that V x / acting on a = {a\ , a 2 , 03) is 

V x /(a) = J^(x) dn(a) + ^(x) dx 2 (a) + ^(x) dic 3 (a) 

= ^-(x)ai + ^(x)a 2 + ^-(x)a 3 . 
aa;i aa;2 0^3 



5.2.1 PRODUCTS OF 1 -FORMS 



The basic 1 -forms in ffi are efai, <ix2, and ^3. The wafge product (or exterior 
product) dx\ A da;2 is de ned so that it is a function of ordered pairs of vectors in 
M 2 . Geometrically, dx\ A dx 2 (a, b) will be the area of the parallelogram spanned by 
the projections of a and b into the (xi , a^-plane. The sign of the area is determined 
so that if the projections of a and b have the same orientation as the positive x 1 and 
x 2 axes, then the area is positive; it is negative when these orientations are opposite. 
Thus, if a = {a\, a 2 , 03) and b = (61, b 2 , 63), then 



ai bi 
a 2 b 2 



a\b 2 — a 2 b\, 



dx\ A c&2(a, b) = det 
and the determinant automatically gives the correct sign. This generalizes to 
dxi A dxj(a, b) = det 



dxi (a) dxi (b) 
dxj (a) dxj (b) 



= det 


a, bi 




dj bj 



(5.2.3) 



(5.2.4) 



1. If oj and p, are 1-forms, and / and g are real-valued functions, then foj + gp is 
a 1-form. 
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2. If u, v, and [i are 1-forms, then (foj + gv) A[i = fuiA[i + gvA[i. 

3. dxi A dxj = —dxj A dxi 

4. dxi A da;, = 

5. dxi A cfej(b,a) = —da;, A dxj(a, b) 



5.2.2 DIFFERENTIAL 2-FORMS 

In K 3 , the most general linear combination of the functions dx^ A dxj has the form 
ci dx 2 A da; 3 + c 2 da; 3 A da:i + C3 da:i A dx2 . If F = (F\ , F 2 , F 3 ) is a vector eld, 
then the function of ordered pairs, 

r x (a, b) = Fi (x) dx 2 A da: 3 + F 2 (x) da; 3 A da;i + F 3 (x) da;i A dx 2 , (5.2.5) 

is a differential 2-form or 2-form. 
EXAMPLES 

1. For the sped c 2-form r x = 2 tfe A da: 3 + dx3 A dai + 5 dxi A da2, if a = (1, 2, 3) 
andb= (0,1,1), then 



7i(a,b) = 2det 



2 1 

3 1 



+ det 



3 1 
1 



+ 5 det 



1 

2 1 



2-(-l) + l-(-l)+5-(l) =2 



independent of x. Note that ax b = det 
(2,l,5)-(axb). 



i j k 

12 3 
1 1 



(—1, —1, 1), and so r x (a, b) 



2. When changing from Cartesian coordinates to polar coordinates, the element of area 
dA can be written 

dA = dx A dy 

= (— r sin 9d9 + cos 9 dr ) A (r cos 9 d9 + sin 9 dr ) 

= -r 2 sin 9 cos 9 (d9 A d0) + sin 9 cos (9 (dr A dr) (5.2.6) 

- r sin 2 9 {d9 A dr) + r cos 2 (9 (dr A d9) 
= rdr A d#. 



5.2.3 THE 2-FORMS IN R n 

Every 2-form can be written as a linear combination of "basic 2-forms". For exam- 
ple, in E 2 there is only one basic 2-form (which may be taken to be da; 1 A dx 2 ) and 
in E 3 there are 3 basic 2-forms (possibly the set {da; 1 A dx 2 , dx 2 A dx 3 , dx 3 A dxi }). 
The exterior product of any two 1-forms (in, say, K ") is found by multiplying the 1- 
forms as if there were ordinary polynomials in the variables dx 1 , ... , dx n , and then 
simplifying using the rules for dxi A dxj. 
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EXAMPLE Denoting the basic 1-forms in IK as dx, dy, and dz then 

(x dx + y 2 dy) A (dx + x dy) = x (dx A dx) + y 2 (dy A dx), 

+ x 2 (dx A dy) + xy 2 (dy A dy), 



(5.2.7) 

- y 2 (dx A dy) + x 2 (dx A dy) + 0, 
(x 2 — y 2 ) dx A dy. 



5.2.4 HIGHER DIMENSIONAL FORMS 

The meaning of the basic 3-form dx \ A dx2 A dx% is that of a signed volume function. 
Thus, if a = (ai,a 2 ,a 3 ), b = (foi , fo 2 , 6 3 ), andc = (ci,c 2 , c 3 ) then 



dx\ A dx2 A dx 3 (a, b, c) = det 



ai hi ci 

Cl-2 &2 C2 

Cl3 h c 3 



(5.2.8) 



which is a 3-dimensional oriented volume of the parallelepiped de ned by the vectors 
a, b, and c. 

For an ordered p-tuple of vectors in ffi", (ai , a2, . . . , a p ), where p > 1 

dx kl A dx k2 A • • • A (ia;^ (ai , . . . ,a p ) = det(dx ki (aj))i=i,..., p . (5.2.9) 

This equation de nes the basic p-forms in IK™, of which the general p-forms are 
linear combinations. Properties include: 

1. The interchange of adjacent factors in a basic p-form changes the sign of the 
form. If uj p is a p-form in M™ and uj q is a g-form in IK™, then 

2. A basic p-form with a repeated factor is zero. 

3. If p > n, then any p-form is identically zero. 

4. The general p-form can be written oj p = J2 il< ... <ip fi 1 ,...,i v dxi 1 A • • ■ Adxt k , 
where 1 <i k <nfork = 1, . . . ,p. This sum has (™) distinct non-zero terms. 



5.2.5 THE EXTERIOR DERIVATIVE 

The exterior differentiation operator is denoted by d. When d is applied to a scalar 
function /(x), the result is the 1-form that is equivalent to the usual "total differen- 
tial" df = V x / = -§^dx!+- ■ • + ■§£; dx n . For the 1 -form to 1 = /i dx+- ■ ■+f„dx n 
the exterior derivative is doj 1 = (dfi) A dx\ + ■ ■ ■ + (df n ) A dx„. This generalizes 
to higher dimensional forms. 

EXAMPLES 

1. If f(xi, xi) = x\ + x\, then df = d(x\ + x%) = 2xi dx\ + Zx\ dxi- 
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2. If u * x ^ I2) = 2:12:2 da:i + (xf + x\) dx 2 , then doj 1 is given by 

do/ = d(xiX2 dxi + (x\ + x%) dx2) 

= (x2 dxi + xi dx-i) A dxi + (2xi dx\ + 2x2 dx2) A dx2 
= xi dxi A dx2- 



5.2.6 PROPERTIES OF THE EXTERIOR DERIVATIVE 

1. If fi(x\,X2) and f^ixi.x^) are differentiable functions, then 

dj x A df 2 = det ( y '^H dii A cfe 2 . 

Vo(Xi,X2j/ 

2. If w p and represent a p-form and a g-form, then 

d(oj p A w«) = (doj p ) A(jj q + {-l) pq oj p A (dw«). 

3. If o; p is a p-form with at least two derivatives, then d(doj p ) = 0. 

(a) The relation d(doj°) = is equivalent to 

curl(grad/) = V x (V/) = 0. (5.2.10) 

(b) The relation d(doj 1 ) = is equivalent to 

div(curlF) = V • (VF) = 0. (5.2.11) 



5.3 INTEGRATION 



5.3.1 DEFINITIONS 

The following de nitions apply to the expression I = f(x) dx: 

1. The integrand is f(x). 

2. The upper limit is b. 

3. The lower limit is a. 

4. I is the integral of f(x) from a to b. 

It is conventional to indicate the inde nite integral of a function represented 
by a lowercase letter by the corresponding uppercase letter. For example, F(x) = 
Ja /(*) dt and G(x) = f* g(f) dt. Note that all functions that differ from F(x) by a 
constant are also inde nite integrals of f(x). We will use the following notation: 
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1. J f(x)dx inde nite integral of f(x) (also written J x f(t)dt) 



2. J f(x) dx de nite integral of f(x), de ned as (for a continuous 

function) 

n — ^rvi \ n ' * 



n— foo \ n 



a H — (b — a) 

n 



3. § c f(x)dx denite integral of /(x), taken along the contour C 

4. f °° /(x) dx de ned as lim / /(x) dx 



5. f(x) dx de ned as the limit of J_ g f(x) dx as R and S inde- 

pendently go to oo 

6. Improper integral integral for which the region of integration is not 

bounded, or the integrand is not bounded 

7. Cauchy principal value 

(a) The Cauchy principal value of f(x) dx, denoted fix) dx, is de- 
ned as lim I / f(x)dx + fix) dx 1 , assuming that / is sin- 

\Ja Jc+e J 

gular only at c. 

(b) The Cauchy principal value of the integral /(x) dx is de ned as the 

f R 

limit of / /(x) dx as R — > oo. 

J-R 



8. If, at the complex point z = a, f(z) is either analytic or has an isolated sin- 
gularity, then the residue of f(z) at z = a is given by the contour integral 
Res/(a) = § c /(£) d£, where C is a closed contour around a in a positive 
direction. 



5.3.2 PROPERTIES OF INTEGRALS 

Inde n ite integrals have the properties (here F is the antiderivative of /): 
1- f[ a f( x ) + bg(x)] dx = a f f(x) dx + b f g(x) dx (linearity). 

2. f f(x)g(x) dx = F(x)g(x) — f F(x)g'(x) dx (integration by parts). 

3. / f(g(x))g'(x)dx = F(g(x)) (substitution). 

4. / fiax + b)dx = \Fiax + b). 

5. If f(x) is an odd function and F(0) = 0, then F(x) is an even function. 
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6. If f(x) is an even function and F(0) = 0, then F(x) is an odd function. 

7. If f(x) has a nite number of discontinuities, then the integral J f(x) dx is 
the sum of the integrals over those subintervals where f(x) is continuous (pro- 
vided they exist). 

8. Fundamental theorem of calculus If f(x) is bounded, and integrable on [a, b], 
and there exists a function F(x) such that F'(x) = f(x) for a < x < b then 

l-X 

i f{x) dx = F(x) \l = F(x) - F(a) (5.3.1) 

J a 

for a < x < b. 
De nite integrals have the properties: 
1. f°f(x)dx = 0. 

2 - la f( X ) dx = ~ fb f( x ) dx - 

3 - la dx + lb f( X ) dx = II f( X ) dx 

4 - la l C f( X ) + d d( x )} dx = c I a f( X ) dx + d I a d( x ) dx 



(additivity). 
(linearity). 



5.3.3 METHODS OF EVALUATING INTEGRALS 
5.3.3.1 Substitution 

Substitution can be used to change integrals to simpler forms. When the trans- 
form t = g(x) is chosen, the integral I = J f(t) dt becomes I = J f{g{x)) dt = 
J f(g(x))g'(x) dx. Several precautions must be taken when using substitutions: 

1 . Be sure to make the substitution in the dx term, as well as everywhere else in 
the integral. 

2. Be sure that the function substituted is one-to-one and differentiable. If this is 
not the case, then the integral must be restricted in such a way as to make it 
true. 

3. With de nite integrals, the limits should also be expressed in terms of the new 
dependent variables. With inde n ite integrals, it is necessary to perform the 
reverse substitution to obtain the answer in terms of the original independent 
variable. This may also be done for de nite integrals, but it is usually easier to 
change the limits. 



EXAMPLE Consider the integral 

I=[—^L=dx (5.3.2) 
J vo 2 -r 

for a ^ 0. Here we choose to make the substitution x = \a\ sin 6. From this we nd 
dx = \a\ cos 8 d6 and 



Va 2 - x 2 = Va 2 - a 2 sin 2 6 = \a\ Vl - sin 2 6 = \a\ |cos 0\ . (5.3.3) 
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Note the absolute value signs. It is very important to interpret the square root radical 
consistently as the positive square root. Thus \fx^ = \x\. Failure to observe this is a 
common cause of errors. 

Note that the substitution used above is not a one-to-one function, that is, it does 
not have a unique inverse. Thus the range of 8 must be restricted in such a way as to 
make the function one-to-one. In this case we can solve for 8 to obtain 

6) = s i n - 1 T ^-. (5.3.4) 
\a\ 

This will be unique if we restrict the inverse sine to the principal values — f < < f . 
Thus, the integral becomes (with dx = \a\ cos 8 d8) 



/a* 
R 



cos ei 



\a\ cos 8 d8. (5.3.5) 



Now, however, in the range of values chosen for 8, we nd that cos 8 is always non- 
negative. Thus, we may remove the absolute value signs from cos 8 in the denominator. 
Then the cos 8 terms cancel and the integral becomes 



•7 



sin 4 8 d8. (5.3.6) 



By application of integration formula #283 on page 430, and simpli cations, this is 
integrated to obtain 

4 q 4 q 4 

1 = sin 3 8 cose - ^- sin6» cos 8+ ^8 + C. (5.3.7) 
4 8 8 

To obtain an evaluation of / as a function of x, we must transform variables from 8 
to x. We have 



cos(9 = ±Vl-sm 2 6) = ±A/l-^r = ± , , X . (5.3.8) 
V or \a\ 

Because of the previously recorded fact that cos 8 is non-negative for our range of 8, 
we may omit the ± sign. Using sin 8 = x/ \a\ and cos 8 = \/ a? — x 2 / \a\ we can 
evaluate Equation (5.3.7) to obtain the nal result, 



|^= = 4V^_^V^ + ^ sin -^ + C . (5 .3,) 



5.3.3.2 Partial fraction decomposition 

Every integral of the form J R(x) dx, where R is a rational function, can be evalu- 
ated (in principle) in terms of elementary functions. The technique is to factor the 
denominator of R and create a partial fraction decomposition. Then each resulting 
sub-integral is elementary. 

„„.„, _ „ . , T f 2x 3 - Wx 2 + 13x - 4 , „, . 

LaAIVIKLL Consider 1=1 t. dx. This can be written as 

J x 2 — bx + 6 

I= I { 2x+ ^^) dx = I { 2x+ ^-^h) dx 

which can be readily integrated I = x 2 + 2 \n(x — 2) — \n(x — 3). 
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5.3.3.3 Useful transformations 

The following transformations may make evaluation of an integral easier: 

1. J / [x, \J x 1 + a 2 ) dx = a J /(a tanw, a sec it) sec 2 u du 

when u = tan -1 - and a > 0. 

a 

2. J / (a;, \/ x 2 — a 2 ) dx = a J /(a sec u, a tan u) sec m tan u du 

when u = sec -1 - and a > 0. 

3. / / [x, V 'a 2 — a; 2 ) dx = a J /(a sin u, a cos w) cos u 

when u = sin -1 - and a > 0. 

4. //( S i na; )dx = 2//( T ^) T ^ 

5. //(cosa ; )d a; = 2//(i=^) ^ 

6. / /(cos x)dx = -J f(v) -^ L - 



du 



7. Jf(smx)dx = ff(u)^—p 

8. / /(sin x, cos x) da; = // (u, \/l - u 2 ) - - 



when z = tan |. 
when z = tan |. 
when ?j = cosar. 
when u = sin a;, 
when u = sin a;, 
when z = tan §. 



9. //(sina ; ,cosa ; )da ; = 2//( T |^,i^) T ^ 

n 

10. f(u) dx = f(x) dx when u = x — ^ — where {a,} is any 

J = l J 

sequence of positive constants and the {cj} are any real constants whatsoever. 

Several transformations of the integral J °° f(x) dx, with an in nite integration 
range, to an integral with a nite integration range, are shown: 



t(x) 


x(t) 


da: 
dt 


Finite interval integral 


e -x 

X 

1+x 

tanha; 


-log* 

i 

1-i 

1 lo K i+i 

2 1U & 1-i 


1 

i 

1 


Jo f (l-i) (l-*) 2 

Jo/^log^)^ 



5.3.3.4 Integration by parts 

In one dimension, the integration by parts formula is 



r 



udv = uv 



-I 



6 



for inde n ite integrals, (5.3. 10) 

for de nite integrals. (5.3.11) 



When evaluating a given integral by this method, u and v must be chosen so that the 
form J udv becomes identical to the given integral. This is usually accomplished by 
specifying u and dv and deriving du and v. Then the integration by parts formula 
will produce a boundary term and another integral to be evaluated. If u and v were 
well-chosen, then this second integral may be easier to evaluate. 
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EXAMPLE Consider the integral 

I = J x sin a dx. 

Two obvious choices for the integration by parts formula are {u = x, dv = sin x dx} 
and {u = sin x, dv = x dx}. We try each of them in turn. 

1. Using {u = x, dv = sin x dx}, we compute du = dx and v = J dv = J sin x dx = 
— cos a:. Hence, we can represent / in the alternative form as 

I = J a sin a da = j udv = uv — j v du = — x cos x + J cosxdx. 

In this representation of I, we must evaluate the last integral. Because we know 
/ cos x dx = sin x the nal result is I = sin x — x cos x. 

2. Using {u = sin x, dv = x dx} we compute du = cos x dx and v = J dv = J xdx = 
x 1 12. Hence, we can represent / in the alternative form as 

I = J x sin xdx = J udv = uv — J vdu = ^- sin x — J ^- cos x dx. 

In this case, we have actually made the problem "worse" since the remaining integral 
appearing in / is "harder" than the one we started with. 

EXAMPLE Consider the integral 

/ = j e x sin x dx. 

We choose to use the integration by parts formula with u = e x and dv = sin a: da:. 
From these we compute du = e x dx and v = J dv = J sin x dx = — cos x. Hence, 
we can represent / in the alternative form as 

/ = y e x sin x dx = J udv = uv — J vdu = — e x cos a + J e x cosxdx. 
If we write this as 

I = — e x cos a + J with J = Je x cosxdx, (5.3.12) 

then we can apply integration by parts to J using {u = e x , dv = cos a da}. From 
these we compute du = e x dx and v = J dv = J cos xdx = sin a. Hence, we can 
represent J in the alternative form as 

J = y e x cos a da = J udv = uv — j v du = e x sin a — J e x sin a da. 

If we write this as 

J = e x sin a - I, (5.3.13) 

then we can solve the linear equations (5.3.12) and (5.3.13) simultaneously to deter- 
mine both / and J. We nd 



I = J e x sin a da = — (e x sin a — e x cos a) , and 
J = J e x cos a da = — (e x sin a + e x cos a) . 



(5.3.14) 
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5.3.3.5 Extended integration by parts rule 

The following rule is obtained by n + 1 successive applications of integration by 
parts. Let 

9i(x) = / g{x)dx, g 2 {x) = / gi{x)dx, 

J J (5.3.15) 

9z( x ) = J g2(x)dx, g m (x) = / g m -i{x)dx. 

Then 

j f(x)g(x) dx = f(x) gi (x) - f(x)g 2 (x) + f'(x)g 3 (x) 

+ + f (n+1) (x)g n+ i(x)dx. (5.3.16) 

5.3.4 TYPES OF INTEGRALS 
5.3.4.1 Line and surface integrals 

A line integral is a de nite integral whose path of integration is along a speci ed 
curve; it can be evaluated by reducing it to ordinary integrals. If f(x, y) is continuous 
on C, and the integration contour C is parameterized by ((f>(t),tp(t)) as t varies from 
a to b, then 

f(x,y)dx= [" f U(t),m) (f>'(t)dt, 
c Ja b V J (5.3.17) 

J f(x,y)dy = Jf rl>'(t)dt. 

In a simply-connected domain, the line integral I = J c X dx + Y dy + Z dz is 
independent of the closed curve C if, and only if, u = (X, Y, Z) is a gradient vector, 
u = gradF (that is, F x =X,F y = Y, and F z = Z). 

Green 's theorem: Let D be a domain of the xy plane, and let C be a piecewise- 
smooth, simple closed curve in D whose interior R is also in D. Let P(a;, y) and 
Q(x,y) be functions de ned in Z) with continuous rst partial derivatives in D. Then 

£(Pdx + Q dy) = jj - ^ dxdy. (5.3.18) 

R 

The above theorem may be written in the two alternative forms (using u = 
P(x, y)\ + Q(x, y)j and y = Q(x, y)\ - P{x, y)j), 

Ut ds = JJ cmludxdy and J v n ds = JJ diwdxdy. (5.3.19) 
R C R 

The rst equation above is a simpli cation of Stokes's theorem; the second equation 
is the divergence theorem. 
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Stokes 's theorem: Let S be a piecewise-smooth oriented surface in space, whose 
boundary C is a piecewise-smooth simple closed curve, directed in accordance with 
the given orientation of S. Let u = Li + Mj + iVk be a vector eld with con- 
tinuous and differentiable components in a domain D of space including S. Then, 
/ ut ds = //(curl u) • n da, where n is the chosen unit normal vector on S, that is 
s 

f fffdN dM\ 

J Ldx + Mdy + Ndz= J J I — - -^-J dy dz 

' C s 

fdL dN\ , , fdM dL\ , , , r „„ m 

\0z ox J \ Ox Oy J 

Divergence theorem: Let v = Li + Mj + Nk be a vector eld in a domain D 
of space. Let L, M, and N be continuous with continuous derivatives in D. Let S 
be a piecewise-smooth surface in D that forms the complete boundary of a bounded 
closed region R in D. Let n be the outer normal of S with respect to R. Then 

J J v„ da = jjj div v dx dy dz, that is 

S R 

J J Ldydz + Mdzdx + Ndx dy 
s 



dL dM dN\ . , , 

-q- + + "q- ^ ^ (fe . (5.3.21) 

aa; ay 



If £) is a three-dimensional domain with boundary B, let eft/ represent the vol- 
ume element of D, let dS represent the surface element of B, and let dS = n (iS 1 , 
where n is the outer normal vector of the surface B. Then Gauss's formulae are 

jjjv -AdV = jj dS ■ A = J J (n • A) dS, 

D B B 

V x A dV = J J dS x A = J J (n x A) dS, and ^ 5 3 22 ) 



_D B 



D B 

where <f> is an arbitrary scalar and A is an arbitrary vector. 

Green's theorems also relate a volume integral to a surface integral: Let V be 
a volume with surface S, which we assume is simple and closed. De ne n as the 
outward normal to S. Let <f> and ip be scalar functions which, together with V 2 <f> and 
V 2 ip, are de ned in V and on S. Then 

1 . Green's rst theorem states that 

f <f>^- dS= [ (^V 2 ^ + • VV>) dV. (5.3.23) 
Js v n Jv 
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2. Green's second theorem states that 



Is " ^) dS = I v ~ dV - (5 - 124) 



5.3.4.2 Contour integrals 

If f(z) is analytic in the region inside of the simple closed curve C (with proper 
orientation), then 

1. The Cauchy-Goursat integral theorem is § c /(£) d(; = 0. 

2. Cauchy's integral formula is 

1 1 /(£) 



™ = hlvh* and nz) = hl c 

In general, ,<»>(,) = ^ ^i^*. 



(5.3.25) 



The residue theorem: For every simple closed contour C enclosing at most a nite 
number of (necessarily isolated) singularities {z\,Z2, ■ ■ ■ , z n } of a (single-valued) 
analytic function f(z) continuous on C, 



A = l 



5.3.5 INTEGRAL INEQUALITIES 

1. Schwartz inequality: f a \fg\ < ^/(l* l/| 2 ) (l* Iffl 2 ) • 

2. Minkowski's inequality: 

(Jt 1/ + sr) 17 " < (£ \f\ p f /P + (l b a \9\ P ) 1/P whenp > 1. 

3. Holder's inequality: 

f b a \fg\ < [f b a \f\ p ] ^ [f' \9\«] ^ when I + I = 1, P > 1, and g > 1. 



4. 



/ 6 /(a;) da; < J"^ |/(x)| da; < I max |/(x)| ) (b — a) assuming a < b. 



5. If f(x) < g(x) on the interval [a, b], then f(x) dx < g(x) dx. 
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5.3.6 CONVERGENCE TESTS 

1. If \f(x)\ dx is convergent, and / is integrable, then f(x) dx is conver- 
gent. 

2. If < f(x) < g(x), J^g(x)dx is convergent, and / is integrable, then 
fa f( x } d% is convergent. 

3. If < g(x) < f(x) and g(x) dx is divergent, then f(x) dx is divergent. 
The following integrals may be used, for example, with the above tests: 

/>oo 



r°° dx f°° dx 

( a ) / —r, r~ an d / — are convergent when p > 1, and divergent when 

J 2 x(\ogx)P J 1 xP 

p < 1. 

f 1 dx 
Jo ~& 



p<\. 
f 1 dx 

(b) / — is convergent when p < 1, and divergent when p > 1. 



5.3.7 VARIATIONAL PRINCIPLES 

If J depends on a function <?(x) and its derivatives through an integral of the form 
J(g) = J F(g,Vg, . . . ) dx, then J will be stationary to small perturbations of g if 
F satis es the corresponding Euler-Lagrange equation. 



Function 


Euler-Lagrange equation 


J R F(x,y,y') dx 


dF d_ ( 8F_\ _ q 

dy dx \ dy' ) 


J R F(x,y,y',...,y( n y) dx 


dF d_ I dF_ \ , I dF_\ _ 

dy dx \dy'J dx 2 \dy" J 

••• + (-1)"£t(^t)=0 


II ^m' 2 +bm' 2 +cu 2 +2fu dxdy 

R L J 


& = / 


II F(x, y, u x , Uy, u X xi Uxyi ^yy) dx dy 

R 


&F d_ ( _dF_\ 0_ ( 0F_\ i 

du dx \du x J dy \du y J 

d 2 ( dF \ | d 2 ( dF \ | 

dx' 2 \.du xx j dxdy \du xy J 

(d 9F )=o 

dy 2 \dUyy J 



5.3.8 CONTINUITY OF INTEGRAL ANTIDERIVATIVES 

Consider the following different antiderivatives of an integral 

'2 tan" 1 (3tanf) 



F(x) = J f(x) dx = J 



5 — 4 cos x 



-dx 



2 tan x (3 sinx/(cosa: + 1)) 
— tan -1 (—3 sin x/ (5 cos a; — 4)) 
[2tan- 1 (3tanf)+27r + IJ 
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where [-J denotes the oor function. These antiderivatives are all "correct" because 
differentiating any of them results in the original integrand (except at isolated points). 
However, if we desire f(x) dx = F(4ir) — F(0) to hold, then only the last 
antiderivative is correct. This is true because the other antiderivatives of F(x) are 
discontinuous when a; is a multiple of it. 

In general, if F(x) = J x f(t) dt is a discontinuous evaluation (with F(x) dis- 
continuous at the single point x = b), then a continuous evaluation on a nite interval 
is given by f(x) dx = F(c) — F(a), where 



F(x) = F(x) - F(a) + H(x - b) 



lim F(x) — lim F(x) 

x—>-b— x— >b+ 



(5.3.27) 



and where H(-) is the Heaviside function. For functions with an in nite number of 



discontinuities, note that ^ H(x — pn — q) 



n=l 



x — q 



5.3.9 ASYMPTOTIC INTEGRAL EVALUATION 

1. Laplace's method: If f'(xo) = 0, f"(xo) < 0, and A->oo, then 



f-xo+e I 



+ . 



(5.3.28) 

Hence, if points of local maximum {a;,} satisfy f'(xi) = and f"(xi) < 0, 
then g(x)e x n*) dx ~ £ . I X{ (A). 

2. Method of stationary phase: If f(xo) ^ 0, f'(xo) = 0, f"(xo) ^ 0, g(xo) ^ 
0, and A-Joo, then 



J X n — e 

~ s(zo) 



2tt 



A|/"(^o)| 



exp 



dx 



'MM + — sgn/"(a;o) 



+ 



(5.3.29) 



5.3.10 SPECIAL FUNCTIONS DEFINED BY INTEGRALS 

Not all integrals of elementary functions (sines, cosines, rational functions, and 
others) can be evaluated in terms of elementary functions. For example, the in- 
tegral J e~ x dx is represented by the special function "erf (a;)" (see page 545). 
Other useful functions include dilogarithms (see page 551) and elliptic integrals (see 
page 568). 

The dilogarithm function is de ned by Li 2 (x) = — J x ln(l — t) /t dt. All inte- 
grals of the form J x P{x, VR) log Q(x, V~R) dx, where P and Q are rational func- 
tions and R = A + Bx + Cx 2 , can be evaluated in terms of elementary functions 
and dilogarithms. 
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All integrals of the form J x R(x, ^jT(x)) dx, where R is a rational function of 
its arguments and T(x) is a third- or fourth-order polynomial, can be integrated in 
terms of elementary functions and elliptic functions. 



5.3.1 1 APPLICATIONS OF INTEGRATION 

1. Using Green's theorems, the area bounded by the simple, closed, positively- 
oriented contour C is 

area = <j> xdy = — <j> y dx. (5.3.30) 

2. Arc length: 

(a) s= I \Jl+y' 2 dx fory = f(x). 

J X\ 

rti 



(b) s = [ \Jft +ip 2 dt for a; = <j)(t), y = ip(t). 

(c) s = £ f^fdO = £ Jl+r' Q\r for r = 1(0). 
Surface area for surfaces of revolution: 

(a) A = 2tt / f(x)\/l + (f'(x)) 2 dx when y = f(x) is rotated about 

J X\ 

the x-axis. 

x\j\ + (f'(x)) 2 dy when y = f(x) is rotated about the 

el 

y-axis and / is one-to-one. 

(c) A = 2ir f ip\J 4> 2 + ip 2 dt for x = <f>(t), y = ip(t) rotated about the 
Ju 



x-axis. 

ft 2 

(d) 



A = 2ir [ 4>\J 4> 2 + ip 2 dt for x = <f>(t), y = ip(t) rotated about the 

Jti 
y-axis. 

(e) A = 2ir / rsmcpur 2 + I —r- ) d<j> for r = r(<j>) rotated about the 

J<Pi V \ d 4>J 

x-axis. 

(f) A = 2ir / r cos &\ / r 2 + I — ) d<p for r = r(<j>) rotated about the 

hi V \#/ 

y-axis. 
4. Volumes of revolution: 

rx 2 

(a) V = 7r / / 2 (a;) for y = f(x) rotated about the x-axis. 
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rt2 

/.2 . 



(b) V = 7r / x 2 f'(x) dx for y = f(x) rotated about the y-axis. 

g 2 (y) dy for x = g(y) rotated about the y-axis. 

el 

*f 

Jt! 

(e) V = 7r / (j> 2 tpdt for a; = ^(£), y = ip(t) rotated about the y-axis. 

Jt! 

(f) V = 7r / sin 2 ^ ( — cos ^ — r sin <j> ) d<f> for r = /((/>) rotated about 

\d<t> J 



(d) V = ir I %p 4> dt for x = <f>(t), y = ip(t) rotated about the a>axis. 

h 

rt 2 



the a>axis. 

/"^ 2 ( dr 

(g) V = 7r / cos 2 ^ ( — sin ^ — r cos ^ 1 d(j> for r = f(d>) rotated about 
J 4,! \d<P 



the y-axis. 

5. The area enclosed by the curve x b l c + y b l c = aV c , where a > 0, c is an odd 

, 2c « 2 [ r (f)] 2 

integer, and b is an even integer, is A — 



6. The integral 7 = JJJ x h 1 y m 1 z n 1 eZV, where i? is the region of space 
R 

fx \P 

bounded by the coordinate planes and that portion of the surface \— J + 

^-J + ^-J = 1, in the rst octant, and where {h,m,n,p, q, k, a, b, c} are 
all positive real numbers, is given by 

/ a;' 1 " 1 da; / y m ~ l dy \ z n ~ l dz 

Jo Jo Jo 

_ a h b m c n F (p) F (?) F (f ) 



pqk p^,m,n + 1 N \ 
\P q k ) 



5.3.12 MOMENTS OF INERTIA FOR VARIOUS BODIES 





Body 


Axis 


Moment of inertia 


(1) 


Uniform thin rod 


Normal to the length, at one 
end 


i 2 

m T 


(2) 


Uniform thin rod 


Normal to the length, at the 
center 


i 2 

m i2 


(3) 


Thin rectangular sheet, sides a 
and b 


Through the center parallel 
to b 




(4) 


Thin rectangular sheet, sides a 
and b 


Through the center 

perpendicular to the sheet 


„ 2 _i_i, 2 




continued on next page 
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Body 


Axis 


Moment of inertia 


(5) 


Thin circular sheet of radius r 


Normal to the plate through 
the center 


r 2 

2. 


(6) 


Thin circular sheet of radius r 


Along any diameter 


r 2 

m— 


(7) 


Thin circular ring, radii n 


Through center normal to 






and ri 


plane of ring 




(8) 


Thin circular ring, radii v\ 
and T2 


Along any diameter 


m 4 


(9) 


Rectangular parallelepiped, 
edges a, b, and c 


Through center 

perpendicular to face ab 
(parallel to edge c) 




(10) 


Sphere, radius r 


Any diameter 


2 2 




(11) 


Spherical shell, external radius 

I 1 , llllCIIlal laUlUS / 2 


Any diameter 




(12) 


Spherical shell, very thin, 
mean radius r 


Any diameter 


2 2 
m 3 r 


(13) 


Right circular cylinder of 
radius r, length I 


Longitudinal axis of the slide 


r 2 

m— 


(.14) 


T?i(Tnt r* i t*r*n 1 q i* r*\?l i n ri i^r cxi 
IVlgllL ^llUUldJ. UyllllUCl Ul 

radius r, length / 


llallsVClaC UlalllCLCl 


m \ 4 + 12) 


(15) 


Hollow circular cylinder, radii 
ri and ri , length / 


LOIlgllUUlIlal aXIS Ol Hie 

gure 


m \ 


(16) 


Thin cylindrical shell, length /, 


Longitudinal axis of the 


mr 2 




mean radius r 


gure 




\ L 1 ) 


Hollow circular cylinder, radii 


Transverse diameter 


" l \ 4 ^ 12 ) 




n and ri , length / 




(18) 


Hollow circular cylinder, very 


Transverse diameter 






thin, length /, mean 






radius v 






(19) 


Elliptic cylinder, length /, 
transverse semiaxes a 
and b 


Longitudinal axis 




(20) 


Right cone, altitude h, radius 


Axis of the gure 






of base r 




(21) 


Spheroid of revolution, 
equatorial radius r 


Polar axis 


2 2 


(22) 


Ellipsoid, axes 2a, 2b, 2c 


Axis 2a 


o 



5.3.13 TABLES OF INTEGRALS 

Many extensive compilations of integrals tables exist. No matter how extensive the 
integral table, it is fairly uncommon to nd the exact integral desired. Usually some 
form of transformation will have to be made. The simplest type of transformation is 
substitution. Simple forms of substitutions, such as y = ax, are employed, almost 
unconsciously, by experienced users of integral tables. Finding the right substitution 
is largely a matter of intuition and experience. 
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We adopt the following conventions in the integral tables: 

1. A constant of integration must be included with all inde nite integrals. 

2. All angles are measured in radians; inverse trigonometric and hyperbolic func- 
tions represent principal values. 

3. Logarithmic expressions are to base e = 2.71828 . . . , unless otherwise speci- 
ed, and are to be evaluated for the absolute value of the arguments involved 
therein. 

4. The natural logarithm function is denoted as log x. 

5. The variables n and m usually denote integers. The denominator of the ex- 
pressions shown is not allowed to be zero; this may require that a ^ or 
m ^ n or some other similar statement. 

6. When inverse trigonometric functions occur in the integrals, be sure that any 
replacements made for them are strictly in accordance with the rules for such 
functions. This causes little dif culty when the argument of the inverse trigono- 
metric function is positive, because all angles involved are in the rst quadrant. 
However, if the argument is negative, special care must be used. Thus, if u > 
then 

sin -1 u = cos -1 \j\-u 2 = esc -1 — = .... 

u 

However, if u < 0, then 

sin -1 u = — cos -1 y/l — u 2 = —tt — esc -1 — = .... 

u 



5.4 TABLE OF INDEFINITE INTEGRALS 



5.4.1 ELEMENTARY FORMS 

1. / adx = ax. 



I. J a f(x) dx = a J 

3. J <t>(y(x))dx = f^jrdy, where y' = f . 

4. j (u + v) dx = j udx + J vdx, where u and v are any functions of ; 

5. J udv = u j dv — j vdu = uv — j v du. 

, f dv , f du , 

6. / u— dx = uv — I v— dx. 
J dx J dx 
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n + 1 

<gx. 



, except when n = — 1. 



7. /,- 

8. /f =lo. 
9- y ^ dx = log /(*), = f(x) dx). 

■/ 2 vf( x > 

■/< 

13. / 1 , .. 

./ a log o 

14. y log a: da: = x log a; — x. 

i5 7"' 



ax = e 



12 I e ax dx 
b ax 



a 



b > 0. 



, a > 0. 



log a 

./ o 2 + ar a 



da: 



is. 

J x z — a z 



— tanh 1 — , 
a a 

or 

1 , a + x 

— log , 

la a — x 

— — coth -1 — , 



a > x 



a 
or 



log 



I \fa 



dx 



a 

x — a 
2a ° x + a ' 
-l £ 

1 FT' 
\a\ 

or 



20 77aTO =1Og (* + V ^^)- 

21. f dx 

J x\fx 2 — i 2 



22. 



iVJ: — a 



/da; 
x\la? ± a: 2 



1 -i a; 
t— r sec — . 
a a 



-log 

a 



a + %/a 2 ± a: 2 



5.4.2 FORMS CONTAINING a + 6z 

23. / (a + te)"<fa;= ( " + n ± -1. 
.7 (n + 1)6 

24. y *(a + da; = ^^y (a + bx) n+2 - p ( ° +1) (a + bx) n+ \ 

-2. 
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25. 



J a 2 (a + bx) n dx = — 



(a + bx) n+s „ (a + bx) n+2 2 (a + bx) n+1 
2a — 1- a 



n + 3 



n + 2 n+1 

n ^ -2, n ^ -3. 



26. J x m (a + bx) n dx = 

x m+1 (a + bx) n an f m n _i 

- — + — x {a + bx) 

1 m + n + 1 ./ 



m + n + 
or 
1 



da:, 



o(n + 1) 
or 

1 



27 
28. 
29. 

30. 



■h 
I 



dx 



b(m + n + l) 
1 



+1 (a + bx) n+1 + (m + n + 2) Jx m (a + bx) n 
x m (a + bx) n+1 — ma J a m_1 (a + bx) n dx 



dx 



+ bx b 

dx 



(a + bx) 2 
dx 



I — 

J {a + bx) 3 

I: 



; + bx 



log \a + bx\. 
1 

b(a + bx) 
1 

~2b{a + bx) 2 ' 

— [a + bx — a log (a + bx)] . 
b 2 

or 

1 ~ ^ lo § ( a + bx )- 



X A — 1 

Tbxf v 



log (a + bx) + 



a + bx 



-1 



+ 



3l h 

fx 1 
32. / - — — — dx = — 

J (a + bx) n b 2 



33. / — - dx = ( i(o + 6a;) 2 — 2a(a + 6a) + a 2 log (a + 6a) ] 
J a + bx 6 3 \2 ) 



{n - 2)(a + bx) n ~ 2 (n - l)(o + 6a)"" 1 

n ^"l, n ^ 2. 



— ;— ^ da = — a + 6a — 2a log (a + 6a) 
+ 6a) 2 b s 1 



35. 
36. 

37. 
38 

39 

40 



/ (a + 



6a) 3 6 3 
1 



da = — ( log (a + bx) + 



2a 



a + bx 

„2 



+ 6a) n dx 6 3 



a + 6a 2(a + 6a) 2 
1 2a 



+ ■ 



(n-3)(a + bx) n - 3 (n - 2)(a + bx) n ~ 2 



(n - l)(o + 6a)"" 1 



n ^ 1, n ^ 2, 7i 



da 



a(a + 6a) a 
da 



1 , a + bx 
log . 



/• da 

' J x{a + 

/dx 
x(a + 6. 



1 



6a) 2 a(a + bx) a 



1 a + bx 
log . 



i a 2 (a 



1 

(a + 6a) 3 a 3 
da 



1 / 2q + 6a Y 

2 \ a + 6a / 



log 



a + bx 



(a + bx) ax a 



1 6 , a + bx 
h — log . 
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41. 



da 



26a -a b 2 , 



42. 



a 3 (a + 6a) 2a? x 2 a 3 a + bx 
dx 



J x 2 (a 



a + 2bx 2b , a + bx 
+ 7? lo g— ■ 



+ bx) 2 a 2 x(a + bx) a 3 



5.4.3 FORMS CONTAINING <?±x 2 AND x 2 - c 2 



43 
44 
45 
46 
47 
48 
49 



/ 
/ 
/ 



dx 1 -i x 

— tan — . 

c c 

1 , c + a 2 ^ 2 

— log , C > X . 



C 2 + X 2 

dx 



'■ — x 2 2c c — x 

dx 1 . X ^22 

2 — 2 - = 7r 1 °g — i - ' x >c - 

2 — ^ 2c a + c 



a^ — c 
a; 



/ 
/ 
/ 



( c 2 ±a .2)„ + l 

da; 



2 

da = =F 



1 



2n(c 2 ±a 2 )" 



(c 2 ±a 2 )" 2c 2 (n-l) 
da 1 



(c 2 ± 



£ to i\ f dx 

a 2 )" 37 + ( " " 3) 7 (^ia 2 )"" 1 



(a 2 -c 2 )« 2c 2 (n-l) 

5 ,./ « 



(a 2 -c 2 )* 



(2n - 3) 



/ 



da 



(a 2 -c 2 )r 



da = i log (a 2 -c 2 ). 
a — c 2 



(a 2 — c 2 ) 



2\n+l 



dx ■ 



1 



2n(a 2 -c 2 ) n ' 



5.4.4 FORMS CONTAINING a + 6x AND c + dx 

u = a + bx, v = c + dx, and k = ad — be. (If k = 0, then v = (c/a)u.) 

52 



/da 1 , fv\ 
= T '°g ( — ) ■ 
lit) K V U / 

53. \ — dx = \ {% log log u") . 

./ ii« « \c d / 

f dx 1/1 d , lA 

/a _ a c j v 

tt 2 i! 6ftii ft 2 ^ u 

f x 2 dx _ a 2 J_ (<?_ 1q ? a(Jfc - 6c) 

J ii 2 w 6 2 ftii ft 2 \ d ^ 



55 
56 
57 
58 



/da 
~~ k(m - 1) 

/ii , bx k , 



i 



,,n — 1 ..,m - 1 



6 2 

6(m + n 



log li 



2)/"-^T 
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59. 



J v n 



dx = < 



1 

~k(n-l) 
or 

1 



d(n — m — 1) 
or 

1 



d(n - 1) 



u m+1 „. /■ ii m 
— + 6(ra - m - 2) / 

U m , f b" 1 " 1 , 1 

+ mk I dx 

,jn-l J y n J 



u m r u m-l ■ 

; — mo I — dx 

yU—l I yll—l 



dx 



5.4.5 FORMS CONTAINING a + bx n 

i xVab 



60 

61 

62 
63 
64 
65 
66 
67 



f dx 1 _i xVab 

/ ; — - = — = tan , ab > U. 

J a + bx 2 ^Jab a 



h 
h 

J a + 

I 

■h 
I 



dx 



+ bx 2 

dx 



:l0g 



a + x\/—ab 

2\/—ab ° a — x\/—ab ' 
or 

1 , _i x\/—ab 
: tann , 



+ bx 

2 



-a6 

1 _i bx 
— dx = — tan — . 

, ab a 

2 dx = ^ lo g (a + bx 2 ). 



<0, 



a6 < 0. 



26 

£ a 



6a: 2 6 6 

da; a 



da: 



+ 6a: 2 
+ 



(a + 6a: 2 ) 2 2a(a + bx 2 ) 

dx 1 j a + bx 

2 — b 2 x 2 2ab ^ a — bx 
dx 



-I- 

2a J a 



dx 



+ bx 2 ' 



(a + 6a: 2 ) m + 1 



1 



x 



2ma (a + bx 2 ) r 
or 

(2m)! 



+ ■ 



2m 



i J (a - 



dx 



(m!) 2 



2ma J (a + 6a: 2 ) 
r!(r- 1)! 



+ 



68 
69 
70 



./ (a 

I 



x dx 



2a f^ i (4a) m - r (2r)l(a+bx 2 y (4 
1 



— I- 

a) m J a 



dx 

+ bx 2 



+ 6a: 2 ) m + 1 
x 2 dx 



2bm(a + bx 2 ) r 
x 



(a + bx 2 ) m+1 2mb(a + bx 2 ) m 2mb 
dx 



m ^ 0. 
"mb j (a 



dx 



+ bx 2 Y 



m ^ 0. 



1 x 
■log 



+ 6a: 2 ' 



' / x(a + bx- ) 2a 

71. / d * = -J-_V- 

./ a: 2 (a + 6a: 2 ) aa: aj a 



dx 



72. 



/ 

J a: (a + 



+ 6a: 2 ) 
da; 



+ 6a: 2 ' 



(a + 6a: 2 ) 



m+l 



1 



2am(a + bx 2 ) r 
or 

1 



+ 



1 /" da: 
a ./ x (a + 6a 



6a: 2 ) r 



2a m+1 



E 



^ r(a + 6a: 2 )' 



+ log 



a + 6a: 2 
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73. 
74. 
75. 
76. 
77. 



/ 
/ 
/ 



dx 



x 2 (a + 6a 2 )' 



_ 1 r dx 6 r 

1-1 ~ a J x 2 (a + bx 2 ) m a J 



dx 



(a + bx 2 ) m+1 



dx _ k 
a + bx 3 3a 



1, (k + x) 3 

— log: - — 

2 8 a + 6a 3 



V3U 



_i2x-k 



x dx 



1 



a + bx 3 3bk 



x 2 dx 



kV3 

1, a + bx 3 rr _i 2i - k 
77 lo S 77 + v 3 tan -=- 

2 s (k + x) 3 kV3 



k 



3/a 
V 6- 



' * — \/f- 



1 



/ 



a + 6a: 3 36 
dx 



— log a + bx" 



a + bx 4 
k_ 
2a 



1, x 2 +2kx + 2k 2 _i 2foc 

77 log — — -tttt: + tan 



' x 2 - 2kx + 2k 2 



2k 2 



or 



k_ 

2a 



78. 
79. 
80. 

81. 
82. 
83. 
84. 
85. 
86. 
87. 



/ 
/ 
/ 



1 , x + k -i x 

2 l0 S^ + tan k 



ab > 0, k = ( 

V46 

ab < 0, jfc = (-^) 



°) 1/4 , 
a\!/4 



a + 6a: 4 
x 



dx 



1 -l x 2 



-tan" 1 - «6>0.* = vT 



26& k 
1 

4W: 



__2f_ da , _ 1 

a + 6a 4 ^ ~ 46& 



1 a 2 + k ' 
1, a 2 -2fcc + 2& 2 _ x 
2 l0g x 2 + 2kx + 2k 2+t!in 



2kx 



2k 2 



ab>0, k=(^) 1/ \ 



x 2 dx 



1 



a + 6a 4 4bk 



log ^n +2tan k 



ab < 0, A; 



a 3 da: 



1 



7— r = -rr loe (a + bx . 

a + 6a 4 46 8 v y 

dx 



I 
I 

f = _ io . 

J x(a + bx n ) an lU& a + bx n 

f dx If dx b f x n d. 

J (a + bx n ) m+1 ~ a J (a + bx n ) m a J (a + bx n 

r x m dx _ i r x m ~ n dx a r x m ~ n <l 

J (a + bx n )P +1 ~ bj (a + bx n )P bj (a + bx n )" +1 



4^ ci. 



— log 



dx 

)m+l ' 

m ~ n dx 



dx 



1 



dx 



dx 



! 



x m (a + bx n Y +1 a J x m (a + bx n Y a J x m ~ n (a + bx n Y +1 

x m (a + bx n y dx 
1 

b(np + m + 1) 
or 

1 



m — n+1 



(a + bx n ) p+1 — a(m — n + 1) j x m n (a + bx n ) p 



dx 



np + m + 1 
or 
1 



(a + bx n ) p +anp J x m (a + 6a n ) p_1 daj , 



a(m + 1) 
or 
1 

an(p + 1) 



x m+1 (a + bx n ) p+1 -b(m + \+np + n) f x m+n (a + bx n ) p 
-x m+1 (a + bx n ) p+1 + (m + 1 + np + n) j x m (a + bx n ) 



dx 



,p+i 



dx 
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5.4.6 FORMS CONTAINING c 3 ± x 3 



88 
89 
90 
91 
92 
93 



dx 
c 3 ± a 3 
dx 



1 f(c±£n 1 _i 2a;Tc 
±— log ( — r | + — — tan 



6c 2 V c 3 ± x 3 
x 



■h 

j (7 3 4- .-. -V" ~ 'V-3^,3 4- , 3 



(c 3 ±a 3 ) 2 3c 3 (c 3 ±a 3 
da: _ 1 

3± x 3)n+l - 3 nc 3 



3c 3 y 



2 %/3 
dx 
c 3 ± a: 3 



3%/3 



(c 3 ± a; 3 ) 



dx 



±x 3 ) n 



xdx 1 

c 3 ± a 3 6c 
a da 



c 3 ±a 



3 ±a 3 ) 2 3c 3 (c 3 ±a 3 ) 3c 3 J c 3 ±a 3 



a da 



1 



/ 

I ' \c 3 ±.c 3 )'H 1 ~ 3(!C 3 

/• 



(c ± a) 3 c%/3 



+ 



3c 3 J c 



_i 2a + c 
c^ ' 
a da 



(c 3 ± a 3 ) 



7 + (3n-2) J 



x dx 



(c 3 ±x 3 ) n 



^= ± Ilo g ( C 3 ± a3). 



95 
96 
97 
98 
99 
100 



a da 



1 



' f a(c 

/ 



(c 3 ±a 3 )"+ 1 
da 



3n(c 3 ±a 3 )« 

3 



1 , x 
■log 



3 ± a 3 ) 3c 3 c 3 ± a 3 

da 1 1 

+ ■ 



log ■ 



a(c 3 ±a 3 ) 2 3c 3 (c 3 ±a 3 ) 3c 6 & c 3 ± a 3 

/da _ 1 1 f dx 

x ( c 3 ± a ,3)n+l = 3nc 3( c 3 

da _ 1 1 f x dx 



0. 



/• 

J a 2 (c 3 ± a 3 ) 

da 



. / _ 

J a 2 (c 



1 1_ /■ 

! ±a 3 )" + c 3 7 a(c 3 ±a 3 )" 
1 1 /" a da 
3 a c 3 y (c 3 ± a 3 ) 

3 ±a 3 )"+ 1 " c 3 i a 2 (c 3 ±a 3 )" T c 3 7 (c 3 ± a 3 )"+ 1 



n ^ 0. 



n ^ 0. 



a da 



101 
102 
103 
104 
105 



da 
c 4 + a 4 

da 
c 4 - a 4 

a da 
c 4 + a 4 

a da 
c 4 - a 4 
a 2 da 
c 4 + a 4 
a 2 da 



1 c + a 
- log h tan 

2 c — a 



1 

2c 3 %/2 
1 

2^ 

1 



2c 2 c 2 ' 

1 , c 2 + a 2 



a + ca 



%/2 + c 2 



ca^ + c 2 
1 x 



5.4.7 FORMS CONTAINING c 4 ± a? 4 

/ 
/ 
/ 
/ 
/ 
/ 



l 

2cV2 
1 

2~c 



log 



^2 + c 2 



1 , c + a 
-log 

2 c — a 



a 2 + ca%/2 + c 2 
-l £ 



+ tan 



sV2 



+ tan 



c^2 



© 2003 by CRC Press LLC 



107 



/ 



X 3 dx 1 4 4 

^ ? = ± i log(c ±x). 



5.4.8 FORMS CONTAINING a + bx + cx 2 

X = a + bx + cx 2 and q = Aac — b 2 . 

If q = 0, then X = c (a: + ^) 2 and other formulae should be used. 



108./ 



dx 
~X 



2 _! 2ca + 6 
— tan — , 

or 

-2 ^ , _! 2ca + 6 
■ tann — ■ 



'-q v 
or 

1 , 2cx + b 



109 
110 

111 

112 
113 
114 
115 



dx 

X 2 



I 

/dx 
X^ 



2cx + b + 

dx 



q>0, 
q<0, 
q<0. 



2cx + b 2c 
qX + ~q J * 



I- 



2cx + b ( 1 3c \ 6c 2 f dx 



f da 

J x- 



dx 



V2X 2 + qX 
2cx + b 2(2n - l)c 



nqX n 
or 

(2n) 



(n! 



qn 

2cx + b 



I 

/dx 
X^' 



x dx 



I 

s 

J x- 

■I 



i 



logX 



Q 

b f dx 

X 2c ~°" 2~J X 
x dx _ bx + 2a b f dx 
~X r= qX q J 

dx 
~ 

x 2 dx 



l)!r! 



(2r) 



qX q J X 
2a + bx b(2n - 1) 



nqX n 
x b 



2c 2 



logX + 



nq 

b 2 — 2ac f dx 
2c 2 ./ X 



dx 

— — , n ^£ 0. 

X n ' ^ 



f x 2 dx (b 2 — 2ac)x + ab 2a f dx 
U6 J— = c^X + TJ X- 



117. [*— 

J X" 



dx 



n — m + 



(2n-m+l)cX n 2n - m 



f 1 6 /• a: m 
+lc7 X" 



+ 



dx 



dx 
~X 



2n — m 



1 a f x m ~ 2 

+ 1 C J X« + ! 



da:. 



da: 

"x' 



/■ da: 1 a 6 /" 

U8 y ^x = ^ l0g x -2^y ■ 

'./ a 2 X ~ 2a 2 ° g a 2 aa + ^2a 2 a) J X' 

f dx _ 1 b f dx 1 P dx , 

J ~x~X^ = 2a{n - ljX"" 1 ~ 2a~ ) X^ + a J aX"" 1 ' ' 
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121 



/ 



dx 



1 



n + m — 1 6 



x m X n + 1 ' (m-l)ax m - 1 X n 



- 1 6 f dx 
1 a J x m ~ 1 X 



2n + m — 1 c f dx 



i-i c r 

1 a J 



x m ~ 2 X n + 1 ' 



5.4.9 FORMS CONTAINING y/a + bx 



+ bxdx = — ^/ {a + bx) 3 . 



122. J s/a~ 

123. f x\/a + bxdx = _ 2 ( 2a ~^ bx ) ^/( a + bx) 3 . 
J lob 2 

f 2 / 7-, 2(8a 2 - Ylabx + 15b 2 x 2 ) n r-^r 

124. / xWa + bxdx = -i ^5 J -y/(a + bx) 3 . 

125. J x m \/a + bxdx = 

x m (a + bx) 3 — ma J x m ~ 1 \/a + bxdx 



b(2m + 3) 
or 

2 



%/a + bx 



m!(-a) r 



r!(m-r)!(2r + 3) 



(a + 6a) 



r+l 



126./ 



Va + bx 



dx = 2\/a + bx + 



/dx 
x\/a + 



127 jv^±E dx 



1 



128 
129 



x" 1 
dx 



(m — l)o 



•\/a + bx 

A /(a + 6a) 3 (2m - 5)6 f \faTbx 



+ ■ 



dx 



2^/a + bx 



I 

. f-i 

J \[a 

f x 2 dx 2(8a 2 -4abx + 3b 2 x 2 ) , =— 

130. / = -i — Wa + bx. 

J Va + bx 156 3 



\/a + bx 

x dx 
\/a + bx 



2(2a - bx) 
3b 2 



Va + bx. 



dx 



\/a + bx 



(2m + 1)6 
or 



1 %/a + bx — ma 



f x " 
J \fa 



\/a + bx 



dx 



2(-a) m Va~+bx~ j2 (-^) r m\(a + bx) 



132 



/dx 
x\/a + 



+ bx 



: tan 



r=0 

. 1 I a + bx 



—a 
or 



(2r + l)r!(m - r)\a r 
a < 0, 



-a 



1 f^/a + bx- Va\ 

— = log ^— , a > 0. 

Va \ va + 6a + 1/0/ 



133. / * 



da; Va + 6a 6 

Va + 6a; aa 2a 



/da 
a%/a + 6a 
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134 



/dx 
x n \fa + 



+ bx 



\/a + bx 



{2n - 3)6 



(n-l)ax n - 1 (2n-2) 
or 

(2w-2)! 



6 f dx 
a J x n ~ 1 Va 



\fa-Vbx ' 



\/a + bx ■sr-^ r\(r — 1)! 

n ^ 



' dx 



r= 1 * r (2r)! 

2{a + bx) {2±n)/2 
6(2 ±n) 



_6_ 

"4a 



[(n-1)!] 2 

135. / (a + 6:r) ±n/2 

136. / :r(a + 6:r) ±n/2 

137 /' - = - f 

./ x(a + bx) n l' 2 a J x(a 

138. / (a + ^ dx = bj(a + bx)^- 2) ' 2 dx + aj 



+ 



b_ 

"4a 



/dx 
x\/a + bx 



2 \(a + bx) (4±n)/2 a(a + bx) (2±n)/2 
dx = — 



b 2 



4±n 

dx 



-I- 

a J (a 



2±n 

dx 



+ &r)(«- 2 )/ 2 a J (a + bx) n / 2 ' 

(a + bx) {n - 2)l2 



dx. 



5.4.10 FORMS CONTAINING >/a + bx AND VF+dx 

and \/c + dx 

u = a + bx, v = c + dx, k = ad — be. 
If k = 0, then i; = -u, and other formulae should be used. 

6d > 0, k < 0, 



139./ 



da: 



2 _j \/bduv 

. tann — , 

Vbd bv 

2 _! ybduv 

. tann — , 

Vbd du 

1 , (6v + Vbduv) 2 

— =log ^ 

V6d « 
2 



: tan 



.1 \/—bduv 
to ' 



-6d 

1 .-if 2bdx + ad + bc\ 
■. sin 



140. J Vuvdx 



V-bd 
k + 2bv 
4bd 



\k\ 
dx 



bd>0, k>0, 
bd > 0, 
bd < 0, 
bd< 0. 



141 



li 



dx 



kd 



1 j d\fu - 

\fkd d\fu + \fkd 
or 

j {d\fu — \fkd}j 

7Id log v 



or 

2 



: tan 



-i d-Ju 



142./ 



x dx 



kd 

uv ad + be 
2bd 



bd 



! 



-kd 

dx 



kd > 0, 



kd > 0, 



kd < 0. 
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143 
144 
145 
146 
147 

148. 



I: 



uv kv 
dx xFuk k f dx 



dx _ 2^/uv 
kv 

/vdx _ \fun k f 

I]fl dx = V\I 



\fwv b 2b J \fun 
v f v dx 

\v\ J \fvM 

2v 



I 



v m \fudx - 


= 1 ( 


(2m + 3)d ' 


dx 


- 1 (. 


v m \fu 


(m — \)k \' 
2 


—= dx = < 

v« 


b{2m + 1) 
or 

2(m!) 2 VM 
6(2m + l)! 



m+l 



r- , fv m dx 
V« + k — =- 
J V u 



+ m 



3\ f dx 
2) J v m ~ x 

\v m \fu — mk / _ dx ] 
V J Vu J 

(2r)\ , 



m ^ 1. 



, _4k 

r—0 



(r!) 2 



5.4.1 1 FORMS CONTAINING y/x 2 ± a 2 

49. y ^Jx^-±ci?- dx = i |a-\/ a 2 ± a 2 ± a 2 log ^a + ^/ x 2 ± a 2 ^J 



%/a 2 ± a 2 
da; 



log ^a + ^ x 2 ± a 2 ^ . 



1 -i a 

= SGC — . 

a%/a 2 - a 2 \a\ a 



dx 



1 , fa + \/x 2 + a 2 

--log 

a V a 



/ 

y iv'j' + !i 

/\Jx 2 + a 2 , — o i ( a + %/a 2 + a 2 \ 
da; = v 21 + a a '°S • 
a ' \ x J 

dx = V x 2 — a 2 — \a\ sec — . 

x " o 

/= da = \/a 2 ± a 2 . 
yx 2 ± a 2 

y x^Jx^^cP dx = —^/{x 2 ± a 2 ) 3 . 
57. y V(^ 2 ±a 2 ) 3 da= i a^ 2 ± a 2 ) 3 ± ^^^x 2 ± a 2 



59 



60 



/ 
/ 



da 



±a 



V(^ 2 ±a 2 ) 3 a 2 V?T±~; 



da : 



(a 2 ± a 2 ) 3 %/a 2 ± a : 



y iV(i 2 ±a 2 ) 3 da = ^V(^ 2 ±a 2 ) 6 . 

/2 4 
x 2 ^Jx^^a? dx = ^ -y/ (a 2 ± a 2 ) 3 =F -^x^J x 2 ± a 2 — ^- log ^a + V 'a 2 ± a 2 ^ . 
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62. J x 3 y / x 2 +a 2 dx = j^(3x 2 - 2a) y'ix 2 + a 2 ) 3 . 

/-^ fl 2 
x^^Jx 2 — a 2 dx = —^J(x 2 — a 2 ) 6 + — ^J(x 2 — a 2 ) 3 . 
5 3 

/2 2 
■s/x*± a 2 dX = f ±a,2zf Y log { x + V^ 2 ±a 2 ) . 
... 



.3 ^ 

. = da: = — y(x 2 ± a 2 ) 3 T a y x 2 ±a 2 . 

Vx 2 ± a 2 3 VV y 



x 2 \Jx 2 ± a 2 

/ * 
7 



da = =F 



\/x 2 ± a 2 



x 3 \/x 2 + a 2 
dx 



dx ■ 



\/x 2 + a 2 1 
2a 2 a 2 + 2^ ° 8 



a + \/x 2 -Fa 2 



3 \fx 2 — ^2 



dX : 



l -i x 

t sec — . 

2|a| 3 a 

,2„ 



Va 2 ± 


a 2 


X 2 


Va 2 + 


a 2 


x 3 


\Jx 2 — 


a 2 


X 3 


Vx 2 ± 


a 2 



X* 1 

x 2 dx 



dx 
dx 
dx 
dx = =F 



%/a 2 ± a 2 



+ log ^a + y' x 2 ± a 2 ^ . 



69. y i V(^ 2 ± a 2 ) 3 ^ = ^V(i 2 ± a 2 ) 5 T ^ V(i 2 ± a 2 ) 3 " * 

Yg log (a + y^xF 

/-i 2 
i 3 V(i 2 ±a 2 ) 3 (ii = -y'ix 2 ±a 2 ) 7 ^ ^- V(^ 2 ± « 2 ) 6 - 
7 5 

/ 
/ 
/ 
/ 
/ 



%/a 2 + a 2 1 
2^ 2^ 



+ %/a 2 + a 2 



a^ — 1 -i x 

2^ + 2W SeC a' 



y'ix 2 ± a 2 ) 3 



3a 2 a 3 
a; 



V(a^ 2 ±a 2 ) 3 v^i 



= + log ( x + ^fx 2 ~^a 2 ) . 

a 2 V. / 



x 2 ± a 2 ± 



%/a 2 ± a 2 
i 

log 



1 



x^J(x 2 — a 2 ) 3 
da; 



1 -i a 

— SeC 

aVa 2 - a 2 |a 3 | a' 



1 



/ 

/" da _ 1 1_ 

' 7 i^iHa 2 ) 3 ~ aVa 2 + a 2 a 3 

/ * 
/ 
/ 

/ 



a + %/a 2 + a 2 



a 



V(a 2 ±a 2 ) 3 a 4 



%/a 2 ± a 2 



+ 



a 



a Va 2 ± a 2 



da 



3 + a 2 3 , 

+ — log 



a 3 V(^ 2 +a 2 ) 3 2a Va 2 + a 2 2a 6 



a + \/x 2 + a 2 



dx 



■ty'ix 2 -a 2 ) 3 2a 2 x 2 ^x 2 -a 2 2aWx 2 - a 2 2\a 



3 -i a 
sec — . 



, a m da 1 m _i / 2 , 2 - 1 
82. / = = — a ±a T 



%/a 2 ± a 2 m 



•i 



m J \/x 2 ± a 2 



dx. 
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183 

184 
185 
186 

187 
188 

189 
190 



/ 

/ 
/ 
/ 

/ 



x 2m dx 



(2m) 



2\m — r (r, \2r— 1 



Vx 2 ± a 2 (m!) 2 

-\/a: 2 ± a 2 ^""^ 



a: 2m+1 da: 
%/a: 2 ± a 2 

da; 



- (2r)! 

+ (=Fa 2 ) m log (a: + V^ 2 ±a 2 )] 

(2r)!(m!) 2 



( T 4a 2 ) m -V 



(2m + l)!(r!) 2 



Va: 2 ± a 2 (m - 2) 

^/ 1^„9„m- 1 * 



a 2 J . 



dx 



x m Vx 2 ±a 2 (m-l)a 2 a: m - 1 (m - l)a 2 J x m ~ 2 ^/x 2 ± a 2 

m-l / im i/n \i«2m-2r-l 



da: 



P 2m 



\/X 2 ±l 

dx 



■\/ x 2 ± a 2 



(m-l)!m!(2r)!2 



(r!) 2 (2m)!(Ta 2 ) m "'-a: 2 '-+ 1 ' 



_ (2m)! 
i 2ra +Vi 2 +a 2 ~ ("i!) 2 



%/a: 2 + a 2 



m — r+1 



r!(r-l)! 



2(2r)!(4a 2 ) m "'-a: 2 '- 



dx 



• 2m + x \fx 



dx 



(2m)! 
(m!) 2 



E 



(-l) m+1 . /V^ 2 +a 2 + a 
+ — lOE 

2 2m a 2m + 1 

r!(r-l)! 



a 2 2(2r)!(4a 2 ) m "'-a: 2 '- 



-I- -l •£ 

2 2 ™ |a| 2m+1 a 



\/x 2 — a 2 



I (x- n )V - - (,/-' a(.c - a) 

/da: _ \/x 2 — a 2 

(x + a)\/x 2 - a 2 a(x + a) ' 



5.4.12 FORMS CONTAINING y/a 2 - x 2 



191 
192 
193 
194 
195 
196 



Va 2 - 


X 2 


dx 




Va 2 - 


X 2 


dx 




xya 2 - 


- X 


Va 2 - 


X 2 


X 




X 





o o , 2 . -1 X 

2 — x 2 + a sin - — : 



. -l x -i x 

sin — = — cos -r—r. 
\a\ \a\ 

1 fa + \/a 2 — x 2 



--log ( 
a V 



/\/a 2 —x 2 . /—„ , (a + \/a 2 — x 2 \ 
dx = y a 2 — x 2 — a log . 
x • \ x J 

/= dx = — V 'a 2 — x 2 . 
ya 2 — x 2 

J xy 1 a 2 — x 2 dx = — — V (a 2 — a: 2 ) 3 . 

197. / V(a 2 -a: 2 ) 3 da:= i (aV(a 2 - a: 2 ) 3 + ^ y 1 a 2 - x 2 + ^ sin" 1 ^ 
J 4 y 2 2 \a\ 

I Via 



198 



199 



V(a 2 - a: 2 ) 3 a 2 \H? 



I \/ia 



dx ■ 



y 1 (a 2 — x 2 ) 3 \fa 
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200. J x^{a 2 - x 2 ) 3 dx = -^V(a 2 -i 2 ) 5 - 

/x 2 V 'a 2 — x 2 dx = — — \l (a 2 — x 2 ) 3 + — ( x^Ja 2 — x 2 + a 2 sin -1 j—r 
4 8 V \a\ 

J x 3 ^Ja 2 — x 2 dx = —x 2 — Yg fl2 ^ V (a 2 — a 2 ) 3 . 

x 2 \J{a 2 — x 2 ) 3 dx = ~q x V ( fl2 — x 2 ) 5 + ~~24~V( a2 ~ x 2 ) 3 



201 
202 
203 



a x i— a . _ 

+ -77" V a - x 2 + — sin 
16 16 



204 
205 
206 



i 2 

a:V( ffl2 -z 2 ) 3 da = -s/(a 2 - x 2 ) 7 - y yV -z 2 ) 5 



-1 x 



I+ i Sm lal 



/da: 
x 2 \/a 2 - 



a z a 



V^ 2 



■ x. 



207. y — 



a^ 



%/a 2 — a 2 . _! a: 

sin |-| 

a a 



208 
209 
210 
211. 
212. 
213. 
214. 
215. 
216 
217 
218 



r 
I 

i— 



■ dx 



2^ + 2^° g 



ii + vn — x 



\/a 2 — x 2 



x dx 



dx 



V(a 2 -x 2 ) 3 
3a 2 a 3 



yj (a 2 — a 2 ) 3 \/a' — x 
x 3 dx 



x . _i x 

— Sin T—r 

2 - t 2 a 



a* — a^ 
a 3 da 



V(a 2 - a 2 ) 3 



- -\/ (a 2 — a 2 ) 3 — a 2 -\/ a2 ~~ x 2 . 
2^ a 2 - a 2 + 



%/a 2 — a 2 %/a 2 — a 2 



/ 
/ 



da 




x 3 ya 2 — 


X 2 


dx 




x^/(a 2 - 


a 2 ) 3 


dx 




x 2 ^J(a 2 - 


-a 2 ) 3 


dx 




x 3 ^J(a 2 - 


-a 2 ) 3 


x m 


da = 



V^ 2 



- a^ 



2a 2 a 2 2^8 
1 



log 



a + %/a 2 — a 2 



2 — a 2 a 



1 , / a + %/a 2 — x 2 
log 



1 / %/a 2 — x 2 



3 — a 



+ 
3 

2 -x 2 2a 6 



a 



' '' / a + \/a 2 — x 2 



log 



x 



- m -Wa 2 -x 2 (m-l)a 



\/a 2 — x 2 



+ 



\/a 2 — x 2 



dx. 



(2m)! 



: da 



(m!) 2 



-\/o 2 — a 2 ^""^ 



H(r-l)! 2m-2r 2r-l 

7 a a 



■i 2 2m - 2r + 1 (2r)\ 



2m 

a . _i 
+ ^ — sin 

22m 
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219. 



f x + dx - -V^^T (2r)!(m!) (isr-'x* 



r d. 

' J x m \fa 
. f 

I 



a? , (m- 2) 

Va 2 - a 2 ~ (m - \)a 2 x m - 1 + (m - 1) 

. m — 1 

ax 



a 2 y 



da: 



m ~ 2 \fa 2 — 



x 2m \/a 2 — x 2 
dx 



-^j a? — x 2 



(m- l)!m!(2r)!2 



a; 

2m-2r-l 



r=0 



(r!) 2 (2m)!a 



2m — 2r ™2r + l 



(2m) 



223./ 



c 2 ™+V« 2 -i 2 (™D 2 



da; 

(b 2 — x 2 )\/a 2 — x 2 



V^ 2 



r!(r- 1)! 



a 2 ^ 2(2r)!(4a 2 ) m "'-a 

1 , /a — \j a 2 — x 2 
■log 



+ 



22m a 2m+l 



26Va 2 - b 2 
or 



log 



(b^/a 2 -x 2 + x^/a 2 -b 2 Y 
b 2 — x 2 



1 _i a%/6 2 — a 2 

: tan 



6V6 2 - a 2 



fcV^ 2 



a 2 >b 2 



b 2 >a 2 



I 
I 



dx 



1 _! x\/a 2 + b 2 

tan 



(6 2 + x 2 )\/a 2 — x 2 b\/a 2 + b 2 b\/a 2 — x 2 

\/a 2 — x 2 , \/a 2 +b 2 . _i x\/a 2 + b 2 . _i a l2 2 

— — — dx = rri sin , — sin -. — r , > a . 

b 2 + x 2 \b\ \ a \ Vx 2 + b 2 H' 



5.4.13 FORMS CONTAINING Va + bx + cx 2 

X = a + bx + cx' 2 , q = 4ac-b 2 , and k = 4c/q. 

Ifq = 0,then\/X = + ±\ . 



226 



/dx 
7x 



1 . {2V^X + 2cx + b\ 

7H log l vt > c>0 ' 

or 

1 . , _i 2ca + 6 
— p sinn — — , c > 0, 

or 



1 . _i 2ca + b 
sin , . 



227. 
228 



dx _ 2(2cx + b) 



I 



da 2(2ca + 6) / 1 



X 2 \fX 3q\/X \X +2k 

2{2cx + b)VX 2k{n-\) 



c < 0. 



da 



X n \fX 



(2n - l)qX 
or 

(2cx + b)(nl)(n-l)\4 n k 



X_ 2k(n - 1) r dx 
11 + 2n-l 7 X-'-'vT' 

n r„n — 1 n— 1 



q(2n)\\fX 



E 



(2r)! 



(4A;X)''(r!) 2 
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dx 

fx' 



233. 



fx- 



Xdx 



' (2cx + b)X n \/X 2n + l 



+ ■ 



4(n + l)c 2(n + l)& 

or 



(2n + 2)! 



fc(2c:r + b)Vx ^ r!(r + l)!(4AX) r 



234 

235. 

236 



[(n + l)!] 2 (4fc)"+ 1 

x dx \fX b f dx 
s/X ~ c 2c 7 Vx' 
dx _ 2(bx + 2a) 
~ ~ q-JX 

Vx 

VX (2n - \)cX 



(2r + 2)! 



/dx 
7x 



I 

t- 

J X\fX 

■I- 

J X n 



b f dx 
~~2~cJ X»7 



y/x- 



„_ f x 2 dx fx 3b \ rr- 3b 2 — 4ac f dx 

237 7 W = U-^)^ + ^^7 

238 f x2<lx - ( 2fc2 ~ 4ac ) x + 2ab I f 

' J X\fX ~ cqVX c 7 s/X' 



239 
240 



/- 

J X" 



dx 



cqVX 

{2b 2 - 4ac)x + 2ab 4ac + {2n - 3)b' 



dx 



\fX (2n-l)cqX n - 1 \/X {2n-\)cq J X n ~^\fX 
x 3 dx ' ' ™ 2 Ku2 o„ \ /i„u kj,3 



f^__5bx_ W_ _ 2a_\ r= f^t__^£_\ f dx 
\3c 12c 2 + 8c 3 3c 2 ) + \4c 2 16c 3 J J sfx' 

_ (n - l)g f x n ~ 2 dx 
\fX nc J Vx 

242. / xVxdx = ^ - ^ 2 +6) ^-A/^- 
J 3c 8c 2 4ck J 



241. = ± x »-iVx-<- 2n -V b [ x - 

J \fX nc 2nc J 



243 
244 

245. 



J xXVxdx = 
y 2X n Vxda: 
Jx 2 Vxdx= (x-f c 



x 2 Vx _ b_ 

5c 2c 

_ x n+1 Vx b 

(2n + 3)c 



J X\fXdx. 



dx. 



246. I 



dx 
;\fX 



56 \ XVX 5b 2 - 4ac 
4c + 16c 2 
bx + 2a ' 



1 . -if 

-, sin 

/-a V 

or 

2\fX 

bx ' 
or 



2VaX + bx + 2a 



J Vxdx 



a < 0, 



a = 0, 



a > 0. 
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247. J 



dx 



248. J ^-dx -. 

249. (^-dx 

J x 2 



dx 



dx 



s/X _ b_ 
ax 2a J x\fX 
1^ b f dx f 

\fX b f dx f dx 

x 2J X sfx C J s/X' 



5.4.14 FORMS CONTAINING s/2ax - x 2 



2ax — x 2 dx ■ 



I* 

. / r . 



dx 
\/2ax - 



(x — a) 2ax — x 2 + a 2 sin 1 —. — p- 



i / a — x 



or 

_i I x — a 



252. J x n ^plax — x 2 dx = 

x n - 1 ^(2ax- x 2 ) 3 (2n + l)a f n _ t 



n + 2 



+ 



n + 2 



2ax — x 2 dx, 



or 

2ax — x 2 



x n+1 (2n + iy.(r\) 2 a n - r+1 

/ <* On — r ( 



n + 2 ^ 2 n ~ r (2r + l)!(n + 2)!n!' 



{2n + \)\a n+2 . _! 
+ ^ — - — — sin 



2 n n\{n + 2)\ 



254 [ ^ 

J \/2ax 



f V2ax - x 2 , J{2ax-x 2 ) 3 n - 3 f ^2ax - 

253. / dx = -7- — -r h 7- -r— / — 

./ x n (3-2n)ax n (2n - 3) a J x n ~ x 

dx 



■ dx. 



\/2ax — x 2 a(2n — 1) f x 



+ 



I 



V2o 



: dx, 



or 



v / j On 



. (2n)\r\(r - iy.a n ~ r r _ x (2n)\a n . _ x / x - a 



255 

256 
257 



' / x n 



dx 



s/2a 



< x 2«-'-(2r)!(n!) 2 



-x - + 



+ 



n-1 



a(l - 2n)x n (2n - l)a 
or 



2«(n!) 2 
I x n ~ x 



dx 



s/2a 



_r^—^ 2"-( w -l)!n!(2r)! 
V 4^ (2n)!(r!) a a— 'z'+i " 



f dx 

J J{2ax - 

I 



(2ax — x 2 ) 3 a 2 \/2ax — x 2 

xdx _ x 
(2ax — x 2 ) 3 a\/2ax — x 2 



5.4.15 MISCELLANEOUS ALGEBRAIC FORMS 



258 



/ 



dx 

\/2ax + x 2 



log (x + a + ^/2ax + x 2 ^ . 
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259. / v; 



ax 2 + cdx = < 



^-\/ax 2 + c H 7 — sin 1 ( x\ — — | , a < 0, 

2 v 2 % /=a V V c/ 

or 

— yj aa 2 + c + _ log \ x\fa + yj aa 2 + c ) , a > 0. 
2 2^/a V / 



260 



/\ I ^ da = sin 1 a: — \/l — x 2 . 
V 1 - x 



261./ 



da 



x\/ax n + c 



1 , \/aa n + c — a/c 

— 7= lo § / „ , , — 7=. 

nyc Vaa n + c + v c 

or 

2 , xjax 11 + c - v/c 
"7= lo § — ' 

or 
2 



c 



262./ 



da 



263 



%/aa 2 + c 
. / (aa 2 + c) 



1 • -i , 
sin | a 

'— a 
or 



c> 0, 

c < 0. 
a < 0, 



log faVa + V ax 2 + c) , a > 0. 



m+l/2 



da 



c(aa 2 + c) m+1/2 (2m + l)c /' 



/ 



(ax 2 + c) 



m-1/2 



2(m + l) 2(m + l) 

or 

(2m+l)!(r!) 2 c m " r 



da, 



a ■\/ax 2 ~+c 



2 2m-2r + l m !( m+ !)!( 2r + 1) 



(aa +cj 



+ 



(2m + l)!c 



| m+l 



/ 



da 



264. / a(aa 2 + c) m+1/2 da 

2 65 . / <2£l±£ 
./ a; 



2 2 ™+ 1 m\(m + l)\ J ^ax 2 + c 
(ax 2 + c) m+3 ' 2 
(2m+3)a 



.m+l/2 



(aa 2 + c) 



2m + 1 



+ c / da, 



or 



\J ax 2 + c 



2r + l +C 



da 



x\/ax 2 + 1 



266 I r-rrk 

J (ax 2 + c) 



m+l/2 



+ ■ 



2m - 2 



/ 



da 



(2m - l)c(aa 2 +c) m ~ 1 / 2 (2m-\)cJ (ax 2 + c)™- 1 / 2 ' 
or 

x y^ 1 2 2m - 2r - 1 (m-\)\m\(2r)\ 
Vax 2 + c (2m)\(r\) 2 c m - r (ax 2 +c) r ' 



267 



da 



Vaa 2 + c (m — 2)c 



Vaa 2 +c (m-l)ca m - 1 (m-\)cj x m ~ 2 \fax 2 ~\ r c 



da 



m ^ 1. 
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268 
269 



f 1+x 2 , 1 . fxV2- 

■ / ; dx = —p= log - 

J (1 -a 2 )^/TT^ s/2 6 V 1 



^/2 + ^/mP [ 



V2 



f 1 ~ ^ 1 _i a 

I , ax = — = tan — = 

J (l+a 2 )Vl + a 4 y/2 VTTx 

„ n f dx 2 /a + %/a" + a 2 
270. / ; = log 

J xy / x n + a 2 na \ s/x™ 

/dx 
f\/f n — /i2 



271 
272 



x\px™ — a 
x 



2 . _! a 
sin — — 

na •Jx" 



dx = — sin 



x a 



■*(!) 



3/2 



5.4.16 FORMS INVOLVING TRIGONOMETRIC FUNCTIONS 

r i 

273. / sin aa da = cos aa. 

J a 

274. / cosaxdx= — sin aa. 
J a 

f 1 1 

275. / tan axdx = log cos ax = — log sec ax. 

J a a 

f 1 1 

276. / cot axdx = — log sin aa = log esc ai. 

.7 a a 

„__ f , 1 , , , 1, /7r aa\ 

277. / sec axdx = — log (sec ai + tan ax) = — log tan 1 . 

J a a V4 2 / 

f 1 1 

278. / esc axdx = — log (esc ai — cot aa) = — log tan 
J a a 

I 

(cos ax) (sin ax + 2) 

3a 



ax 
~2~' 

279. / sin 2 axdx = — — — cos ax sin ai = - — — sin 2aa 
2 2a 2 4a 



, . 4 , 3a sin 2aa sin 4aa 
281. / sin ax ax = — - h 



4a 32a 

,71-1 



/■ 

/. „ , sin" 1 ax cos ax n — 1 f . n _2 , 
sin axdx = 1 / sin axdx. 
na n J 

/m—l 
■ 2m , COS ax \r— 

sm axax- a ^ 2 2m - 2 >-(2r + l)!(m!) 2 ' 2 2 ™(m!) 2 " 

/m—l 
sin 2m+1 aada = -^^ £ 
^ « — n 

/■ 



, ,., , • • \ • (2m)!(r!) 2 . 2r+1 (2m) 

cosaa^ 1 2 2m - 2, -(m!) 2 (2r)! . 2r 

-77. 7TT, \o sin aa. 

r=0 (2m+l)!(r!) 2 

• 1 1 ■ 1 1 • „ 

285. / cos ax dx = —a H sm ax cos ax = —a H sm 2aa. 

2 2a 2 4a 

286. / cos 3 axdx = ^- sin ax (cos 2 ax + 2). 
i 3a 

, 4 , 3 sin 2aa sin 4aa 

287. / cos axdx = -a H - h 



4a 32a 



/■ 

/n i 1 n—1 • n — 1 / n— 2 » 
cos axdx= — cos aa sin aaH / cos axdx. 
na n J 
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289. / cos ax dx = 



290. / cos 2m+1 axdx 
dx 



291 

292 

293 
294 

295 
296 

297 

298 

299 



/ 
/ 

r dx r 

J sin 2 ax J 

I 
I 
I 



Y. 



(2m)!(r!) 2 



2 2m ~ 2r (2r + l)!(m!) : 



2r+i , (2m)! 
■cos ax + „„_ , — —x. 



2 2m (m!) r 



: E 



2 2m - 2r (m!) 2 (2r)! 
(2m + l)!(r!) 2 



cosec aa da: : 



1 



■ cot ax. 



dx 
sin" 1 ax 

dx 



I 



cosec m ax dx 



cos ax m — 2 
+ 



o(m — 1) sin m 1 ax m - 



dx 



- — cos ax 
a 



-i 2 2m - 2r - 1 ( m -iy.m\(2r)\ 



E 



(2m)!(r!) 2 sin 2r+1 aa 



2m+l . 

cosec axdx = 

m ~ 1 MfVh 2 



- — cos ax 
a 



I 
I 

/- 

J cos 

/ 



r=0 



(2m)!(ri; 



+ - 



1 (2m) 



2 2m-2r( 2r + l)!( m !) 2 sin 2r + 2 ai ' a 2 2m (m!) 2 logtan 2 ' 



cos z ai 

da 
cos m ax 

dx 
cos 2 ™ ai 

da; 



j sec 2 axdx = — tan aa. 



/ 

= / 



sec m aa da : 



1 



sin ax m — 2 
+ 



da 



a(m — 1) cos m_1 aa m—lj cos" 1 ~ -° aa 

— 1 ^ 2m - 2 '- 1 (m- l)!m!(2r)! 
,:. (2m)!(r!) 2 cos 2 ' - + 1 aa 



sec axdx = — sin aa 



■ 



I 



2m+i j 1 (2m)! , . 

sec axdx = — — — log (sec ax + tan ax ) 



1 



a2 2m( m! )2 
ro — 1 



+ — sin ax 



E 



(2m)!(r!) 2 



2 2m-2r( m !)2( 2r + l)! COS 2r+2 a;E - 



/ 



sin ma) (sin na) da : 



sin (m — n)a sin (m + n)a 9 . 9 

— — m ± n . 



2(m — n) 



2(m + n) 



300. / (cos ma) (cos nx) dx 



sin (m — n)x sin (m + n)x 9 9 

m ± n . 



2(m — n) 



2(m + n) 



301. / (sin ax) (cos ax) dx = — sin 2 aa. 
' 2a 



/< 

302. / (sin ma) (cos na) da — 
./ ^ A ^ 2(m-n) 

303. / (sin 2 ax) (cos 2 ax) dx = — — |— sin 4aa + 
./ 32a 

304. y"(sinaa)(cos m aa) da = 

305. y (sin m aa) (cos ax) dx - 

306. y (cos m ax) (sin n aa) da = 

aa sin n+1 aa m 
+ 



cos (m — n)a cos (m + n)a , , , 

or a. ^ ' m 2 £n 2 . 

2(m + n) 



(m + l)a 



(m + l)a 



(m + n)a 



m + n 



If 



(cos m 2 ax) (sin n aa) da, 



or 



(m + n)a 



+ 



n - 1 /' 
m + n J 



(cos m aa) (sin n ax)dx. 
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307 



/" cos" 1 
J sin" i 



■ da ■ 



a(n — 1) sin n 1 ax 
or 



+ ■ 



308 



309 



f sin" 1 , 

' J COS" ( 



■ dx ■ 



■ dx ■ 



a(m — n) sin" 1 ax m — n 
m — n 



■ + 2 r cos" 
1 7 sin"" 

1 /• cos m - 2 aa 
y sin" aa 



■ da, 



■ da. 



o(n — 1) cos n_1 ax 
or 



n - 



+ 



a(m — n) cos n_1 ax m — n 
1 sec ax 



f sin 2 ax , 1 . 1 , /"k ax 

310. / da = sinaiH — log tan — + — 

J cos aa a a \4 2 



+ 2 /• sin" 
1 y cos"- 

1 /" sin m - ; 
ra J cos n ( 



■ da, 



■ da. 



cos^ aa 

2 



311. 
312. 
313 
314 
315 



■ da : 



/ 
7 



dx 



(sin aa) (cos ax) a 
dx 

(sin aa) (cos 2 aa) 
da 



log tan ax. 

If , ax\ 

— sec ax + log tan — 

a \ 2 J 

1 



/ 



(sin aa) (cos" aa) a(n — 1) cos" -1 ax 
dx 

(sin 2 ax) (cos ax) 



dx 



dx 



(sin ax) (cos" -2 ax) ' 

1 1 , fn ax\ 

- esc ax H — log tan ( — + — ). 

a a V4 2 / 

2 



(sin 2 aa) (cos 2 ax) a 



cot 2aa. 



da 



sin ax cos" aa 



1 



a(m — 1) sin m 1 aacos n-1 aa 
or 

1 

a(n — 1) sin m-1 ax cos" -1 ax 



+ ■ 



m + n 



i y ; 



dx 



dx 



sin ax cos n-z aa 



318. / sin (a + 6a) da = — — cos (a + bx). 



j sin (a ■ 

319. j cos (a + bx) dx = ^ sin (a + 6a). 

/da 1 fn ax\ 

___ = T _tan( iTT j. 

A 

' I a~+ 



320 
321 
322 

323 



da 1 ax 
= - tan — . 

+ cos ax a 2 



6 sin a 



1 ax 
- — cot — . 
a 2 



Va 2 - 6 2 
or 



a tan f + 6 
Va 2 - 6 2 y 



%/6 2 



a tan f + 6 — %/6 2 — a 2 
1 atanf + 6 + V6 2 - a 2 
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■h 



dx 



+ b cos a 



dx 



Va 2 - b 2 
or 



tan 



_! \/a 2 — b 2 tan | 
a + 6 ' 



V6 2 



, V6 2 - a 2 tan f + a + b 

: log — ^=^= 

V6 2 — a 2 tan § — a — b 



+ b sin x + c cos a: 



1 



(b - yfb' 2 + c 2 - a 2 + (a- c) tan f , , 
'°g I , . ^= , — M. «^ c ' « <6 +c 2 , 



%/6 2 + c 2 — a 2 1 6 + %/6 2 + c 2 — a 2 + (a — c) tan 
or 



%/a 2 — b 2 — c 2 
or 



tan 



_! 6 + (a — c) tan | 
\/a 2 —b 2 — c 2 



a — (b + c) sin a: — (6 — c) sin £ 



a — (6 + c) sin x + (b — c) sin a 



2 1,2 . 2 



2 i2 . 2 

a = o + c 



326. 
327 



sin 2 x ^ 
a + b cos 2 x b 



1 /a + fc _i 
tan 



328 
329 
330 

331 

332 



■A 

7: 
/: 



dx 



2 cos 2 x + b 2 sin 



o 
1 

a6 



tan 



a + b 

_! / 6 tan x 
V a 



tana J — — , a6 > 0, |a| > 



cos cx 



Va 2 + b 2 _! Va 2 + b 2 tan ca a 

da = — tan — . 

2 + b 2 sin cx ab 2 c a b 2 



sin cx cos ca 



■ da : 



cos 2 ca + 6 sin 2 ca 2c(6 — a) 

cos cx 



log (a cos 2 cx + b sin 2 ca) , a ^ b. 



cos cx + b sin ca 



■ da : 



7: 



/ 



da 



1 



cos cx + b sin ca 



o + 6tanca c(a 2 +6 2 ) 
da = 



/ 

da 



da 



1 



6 + ocotca c(a 2 +6 2 ) 



[oca + b log (a cos cx + b sin ca)] . 



[6ca — a log (a cos cx + b sin ca)] . 



cos 2 a + 2b cos a sin a + c sin 2 a 
1 



2^/W 
or 
1 



- ac 



log 



: tan a + b — \fb 2 



ac 



\/ac — b 2 
or 

1 



: tan 



c tan x + b + \/b 2 — ac 
i I c tan x + b 



\/ac — b 2 ) ' 



b 2 > ac, 
b 2 < ac, 



333. 
334. 
335. 



c tan a + 6 ' 

/sin aa , 1 ax\ 

— — da = ±a + - tan I - q= — . 
lisinai a V 4 2 I 

dx 1 /7r ax\ 1 , aa 

— — : = — tan I — T — H — log tan — . 

(smoa)(l±smoa) a V4 2 / a 8 2 

1 /7T ax\ 1 3/7T aa\ 

- — tan — — — — tan — — . 

2a V4 2 J 6a \4 2 J 



I 
I 



dx 

(1 + sin ax) 2 
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336 
337 
338 
339 
340 

341 

342 

343 



/ 
/ 
/ 
/ 
■/ 

■/ 

/ 



dx 



1 /7T ax\ 1 a /7T ax\ 

— cot ( - - — + — cot 3 ( — — ) . 

2a \4 2 J 6a \4 2 J 

1 /7T ax\ 1 3/7T ax\ 

. „ dx = — — tan — — + — tan — — . 

(1 + sin aa) 2 2a \4 2 J 6a \4 2 J 



(1 — sin ax 
sin ax 



sin ax 



(1 — sin ax) 2 
sin x 



dx ■ 



2a 



cot 



/7T ax\ 1 a fit 



aa\ 
~2A 



a + b sin a: 

da; 



dx 



dx 



— - = — log tan 

(smi)(a + DSini) a 2 



dx 



a + b sin x 
x b 
a 

b cos x 



I a + 



dx 



b sin x 
a 



(a + b sin a) 2 
dx 

a 2 + b 2 sin 2 cx ac\[i 



b 2 J a + 
-I- 

(b 2 — a 2 ) (a + 6 sin a) b 2 — a 2 J a 

1 -\f Va 2 + b 2 tancaA 

, tan . 

a 2 +b 2 V « / 



(a 2 — b 2 )(a + 6 sin a) a 2 — 
or 

a cos a; 6 



6 sin x 
dx 



+ b sin x 



dx 



i 2 — 6 2 sin cx 



ac\/a 2 — b 2 
or 

1 



344 

345. 
346. 
347. 
348. 
349 



/ 
/ 



cosaa 
1 + cos ax 

cos ax 
1 — cos ax 
dx 



dx 
dx 



2ac\/b 2 — a- 

1 ax 
— tan — — . 

a 2 

1 ax 

cot — . 

a 2 



tan 



log 



\/a 2 — b 2 tan cx 



Vb 2 



- a 2 tan cx + a 



Vb 2 



■ a 2 tan cx — a 



a 2 >b 2 



a 2 <b 2 



J 



1 , /7T ax\ 
= - log tan - + — 

(cosaaj(l + cosaa) a V4 2 J 

dx 1 , /7T ax\ 

7 tt; r = - log tan I - + — 

(cosaaj(l — cosaa) a V4 2 J 

dx 1 



1 ax 

— tan — -. 

a 2 

1 ax 

— cot — . 



(1 



350 
351 
352 
353 
354 
355 



■/ 
/ 
/ 
/ 
/ 
/ 
/ 



• cos ax ) 
dx 



ax 1 3 ax 

— tan tan — . 

2a 2 6a 2 



(1 — cosaa) 2 

cos ax 
(1 + cosaa) 2 

cos ax 
(1 — cosaa) 2 

cos a 



dx ■ 
dx ■ 



1 ax 

- — cot — 

2a 2 

1 ax 

- ^— tan — — 

2a 2 

1 ax 

- IT- COt — 

2a 2 



1 ■> ax 
— cot 3 — . 
6a 2 



3 ax 

— tan — . 

6a 2 



1 

6a 

1 3 ax 
— cot — . 
6a 2 



a + b cos x 
dx 



dx - 



+ b cos x 



(cos a) (a + b cos a) 
dx 



a_f 
bj a 

1 , /a 7r\ b [' 

-- -logtan I - + 7 ) - - / - 
a \2 4J a J a 

2 ~^J 



dx 



b sin a 



(a + b cos a) 2 (b 2 — a 2 )(a + 6 cos a) 
cos a , a sin a 



(o + 6cosa) ; 



■ dx ■ 



+ b cos a 
da 

a + b cos x ' 
dx 



(a 2 — b 2 )(a + 6 cos a) a 2 — b 2 



I a + 



6 cos a 
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357 



358 



A 
A 



dx 



2 + b 2 — 2ab cos cx c(a 2 —b 2 ) 



tan 



i / a + b 



, tan — 

a-b 2 



dx 



1 



2 + b 2 cos 2 cx acVa 2 + b 2 
1 



tan 



A 



dx 



2 — b 2 cos 2 cx 



_i atancx 
Va 2 + 6 2 ' 

a tan cx 



ac\/a 2 — b 2 
or 

1 



tan 



:log 



Va 2 - b 2 



a tan cx — \/b 2 — a 2 



2ac\/b 2 — a 2 \ a tan cx + \/b 2 — a 2 



a 2 >b 2 



b 2 >a 2 



, smni 1 

359. / - — ■ da; = =p— log (1 ± cos ax I. 

± cos ax a 

cos ax 1 , . . 

— — : ax = ±— log (1 ± smax). 

1 ± sin ax a 



360. 
361. 
362. 
363. 
364. 
365. 
366. 
367 
368 
369 
370 



■A 
/ 
/ 



dx 



1 



1 j ^ ax 

(sin ax) (1 ± cos ax) """2a(l ± cos ax) 2a °^ an 2 ' 



dx 



(cos ax) (1 ± sin ax) 2a( 



1 1 (ax 7T\ 

___^ + _ logtan ^_ + _j. 



sin ax 



/ 
/ 



(cos ax) (1 ± cos ax) 

cos ax 
(sin ax) (1 ± sin ax) 

sin ax 
(cos ax) (1 ± sin ax) 

cos ax 
(sin ax) (1 ± cos ax) 

dx 



dx : 
dx = 
dx = 
dx = 



1 



log (sec ax ± 1) 



1 



log (esc ax ± 1). 



1 



1 , (ax n\ 

-logtan( T + I j. 



2a(l±sinax) 2a 

1 1 ax 
; ± — log tan — 

2a(l±cosax) 2a & 2 



sin ax ± cos ax 
dx 



1 /OX 7T\ 

_,ogtan( T± -j. 



, — tan (ax =F — 1 • 

J (smax ± cos ax) 2 2a V 4/ 

dx 1 / ax\ 

-log (l±tan T j. 



A 

A 
/ 
/ 
/ 
/ 



+ cos ax ± sin ax 
dx 

2 cos 2 cx — 6 2 sin 2 cx 2a6c 



1 , / otancx + a 
— log 

ibe \ otancx — a 



371. / x sin axdx = — sin ax — — cos ax. 



372. / x 2 sin axdx = — % sin ax H %—— cos ax. 



373. / x sin ax dx : 



6x — a 2 x 3 
■ sm ax H cos ax. 



374. / x m sin ax dx : 
1 



-— x cos ax + 
a 

or 



/" m-l 

a/ 1 



cos axdx, 



I m I I m^l I 

\^ (-l) r+1 m! x m " 2r . L vV (-l) r m! x m - 2r - 

cos ax > — — — — I- sm ax > -, —rr — „ , „ 

^ (m-2r)\ a 2r + x ^ (m - 2r - 1)! a 2r + 2 
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375. / a cos axdx = — cos ax + — sin ax. 

a 1 a 

2 , 2a a 2 x 2 — 2 . 

376. / x cos ax ax = — — cos ax H 5 sinoi. 

a 2 a 15 

,__ , 3 , 3a 2 a 2 — 6 a 2 x 3 — 6a . 
ill. I x cos ax ax = -. cos ax -\ smai. 



s A 
I- 
I- 



378. / x cos ax dx 

x m . 



a 



m f m _i 



sin ax dx, 



or 



I m I I m=l I 

L ^ J (-l) r m! a m " 2r L .A J (-l) r m! a;" 

> 7 ?TTT o , i + cos ax > 

^ (m - 2r)! a 2 ^ 1 ^ 



(m-2r-l)! a 2r + 2 



(ax) 



2n+l 



a; 

cos ax 

x 



n=0 

oo . . 

d _ V^/_ 1 xn 



n=0 

381. / x sin 2 axdx = 



(2n + l)(2n + l)!' 

2n 

(2n)(2^)!' 



x 

4o"' 



sin 2aa ■ 



cos lax. 



382. / a sin axdx = — [ — 



4a 8a 3 

383. / x sin 3 ax dx = -7— cos 3ax — — - 
12a 36a 2 



389 
390 
391 



/ 

/ 
/ 

/ 

r 2 2 J x 3 /x 2 1 

. / a cos axdx = — + — 

J 6 \4a 8 « 

/ 

/sin ai _ sin ax a f cos as 

x m X ~(l- m )x m - 1 m-lj x m ~ x 

/cos ax _ cos ai a ( sin aa 

a m 21 ~~ (1 - m)x m - 1 l-mj x m ~ l 

A 

/t 
/t 



sin 2aa — — - cos 2aa. 
4a 2 

3a 

4a 



_3_ 

4a 2 



384. / x cos 2 axdx = ^-r + -7- sin 2aa + —^7 cos 2ax. 
4 4a 8a 2 

22 a 3 / ~ 2 

385. / a cos axdx = — + 



sin 2aa + - — - cos 2aa. 
4a 2 



, 3 x 1 3a: . 3 

386. / x cos aa dx = — — sin 3aa + — - cos 3aa + — sin ax + — - cos ax. 

12a 36a 2 4a 4a 2 



± sin ax 

x 



+ cos ax 

x 



dx. 



dx. 



, a cos aa 1 , , . N 

dx = T— ^— ; — : r + -r log (1 isinoi). 

a(l ± sin ax) a 2 

, a ai 2 ax 
dx = — tan — H — - log cos — . 



- cos ax 



tat , x + sinx 
392. / dx = x tan 

+ cos x 2 



! A 

A 
394. y yr 



a^ 

, a ai 2 . aa 

da = cot — + — log sin — . 

a 2 a 2 

x 



393. / — — smx fix = —a cot — . 

■ cos a 2 



cos aa dx 



2 sin aa 
a%/l — cos< 



2^2 



■ cos 

a 2 
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395. 

\A + cos ax dx 



2 sin ax 2\f2 . ax 

— = = sin — . 

avl + cos aa a 2 



396 



/ 

For the following six integrals, each k represents an integer. 



+ sin a da = < 



■I* 
I 



sin xdx = < 



dx 



2 ( sin f - cos f ) ' 


(8fc - l)f <x< (8Jfc + 3)f 


or 




-2 (sin |- cos |), 


(8/c + 3)f < x < (8fc + 7)f 


( n ( ■ x x \ 
2 ^ m -+cos-j, 


(8Jfc-3)f <a< (8fc + l)f 


or 




_ / . X x\ 
-2 [sm - + cos - J , 


(8k + l)f <x< (8k + 5)f 



%/l — COS X 



a/2 log tan ^, 4&7T < a < (4k + 2)tt, 



or 



/ 



da: 



a/1 + cos a: 



da 



401. /" , d " 

J v 1 + sin a 



-a/2 log tan |, (4k + 2)n < x < (4k + 4)n. 

a/2 log tan (^^"), (4/c - 1)tt < a < (4/c + 1)tt, 
or 

-a/2 log tan (^^), (4/c + 1)tt < a < (4fc + 3)tt. 

V^logtan(|- |), (8& + l)f <x< (8fc + 5)f , 
or 

V21ogtan(|-|), (8fc + 5) f <a< (8/c + 9)f . 

a/2 log tan (| + ^), (8fc-l)f <a< (8fc + 3)f , 



or 



-V21ogtan(| + |), (8fc + 3) f <a< (8fc + 7)f. 



402. / tan 2 axdx = — tan aa — a. 



403. / tan 3 axdx = — tan 2 aa H — log cos aa. 



2a 



a 



/ 4 1 3 -1 

404. / tan axdx = — tan ax tan ax + a. 

3a a 

405. / tsn n axdx=—, -r-tan n_1 ax— f tan n ~ 

J a(n - 1) J 

2 1 

406. / cot axdx = cot ax — a. 



' ax dx. 



407. / cot ax dx ■ 



409 
410 



/ 
/ 
/ 

/cot" 

.7 a(n-l) 

— f — dx = 
sin aa ./ 



1 2 1 , 

— cot ax log sin ax. 

2a a 

408. / cot 4 ax dx = — — cot 3 ax H — cot aa + a. 
3a 



a 



' ax dx ■ 



/„.- 



' aa da. 



a , / 2 , a; cot ax 1 

■5 da = / a esc axdx = 1 — - log sin aa. 

sin ax J a a 2 - 
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411. 

412. 
413. 

414 
415 
416 
417 

418 
419 
420 

421 

422. 



sin n 


ax 


X 




cos 2 


ax 


X 





dx ■ 



dx ■ 



■ J xcsc n 



ax dx ■ 



a(n — 1) sin n 1 ax 

1 n-2 



+ 



a 2 (n — l)(n — 2) sin" ax n 
■ j x sec 2 axdx = — tan aiH — - log cos ax. 



1 J sm n ~ 



■ dx. 



I 



dx = I x see" ax dx - 



a a*- 
x sin ax 



a(n — 1) cos n_1 ax 

1 . n-2 



/sin ax 
y/l + b 2 sin 2 ax 

/sin ax 
y/l — b 2 sin 2 ax 



a 2 (n — l)(n — 2) cos n_2 ax ~*~ n 

, l._i b cos ax 

dx = - sin , . 

ab ^/T+W 



-[ — 

1 J cos n ~ 



■ dx. 



dx 



- log (b cos ax + Vl — b 2 sin 2 ax) . 
ab \ ) 



. J (smax)\f\ 
y"(sin ax)^/l 



1 + b 2 sin 2 ax dx ■ 



1 — b 2 sin 2 aa dx - 



cos aa 
2^~ 

cos ax 
2a~ 



+ b 2 sin 2 ax- 



\J\ —b 2 sin 2 ax 



1+6 . _ i b cos aa 
„ , sin 
2ab 



1-6 2 
2ab 



log (b cos ax + b 2 sin 2 aij . 



/ cos aa , 1 , /, . r , ■ 9 \ 

— . dx = — log o sin ax + V 1 + o sin aa . 

VI + b 2 sin 2 ai a6 V 

/cos ai 
7T 



da = — sin 1 (osinaa). 

2 cin 2 nr aO 



\f~\ Ti sin a.c 



. j (cosax)^/. 



1 + 6 2 sin aa dx ■ 



2a 



Vl +6 2 : 



j (cos ax)^f . 
For thf 

/_ 

7 \/a 



+ ■ log ( b sin aa + Vl + & 2 sin 2 aa^) . 
2ao V / 



1 — 6 2 sin 2 aa dx = — Vl — b 2 sin 2 aa + — - sin 1 (6 sin aa) . 

2a 2ao 

For the following integral, k represents an integer and a > \b\ 

dx 



+ b tan 2 ca 



1 



c\/a — b 
or 
-1 

c\/a — b 



423 



424 



425 



f -i 

/cos n xdx = - — - 
2n-l 

k=0 

n-1 

/cos n xdx = - — - > 
2n-l 
; n 



/sin" xdx = - — 7 [ ™ 
2 n-l U 



a — b 



sin ca , (4Jfc - l)f < a < (4Jfc + l)f , 



a — b 



sin ca , (4k + l)f < a < (4& + 3)f . 



sin f(n — 2&)al 1 ( n , 

(w _ 2 fc) + 2^ I f I' " ' S 1,11 CVC " " UCgCr - 



sin [(n — 2&)a 



(n - 2fc) 
sin([(w-2fc)(f - a)]) 



n is an odd integer. 



1 n 



(2k - n) 



n is an even integer. 
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426. / sin n a dx ■ 



2 n 



.([(n-2fc)(f -a)]) 
(2k - n) 



n is an odd integer. 



5.4.17 FORMS INVOLVING INVERSE TRIGONOMETRIC 
FUNCTIONS 



427. / sin axdx = x sin ax + 



i %/l — a 2 x 2 



,,,, , -i j -l \/l - a 2 
428. / cos axdx = x cos aa 



/sin" 1 

^. / cos _i 

/tan -1 axdx = x tan -1 aa log (1 + a 2 x 2 ). 
2a 

/cot -1 axdx = acot -1 ax H log (1 + a 2 x 2 ). 
2a 

■ j sec -1 axdx = x sec -1 aa log (ax + a 2 x 2 — 1^ . 

432. y esc -1 axdx = x esc -1 aa + — log ^aa + V a 2 a 2 — . 

433. / (sin -1 — ) dx = a sin -1 — + ^fcp 
J V a) a 



429 
430 
431 



a 2 , a > 0. 



434. / (cos 1 — ] dx = x cos 1 — — ^fa 2 — x 2 , a > 0. 
J V a/ a 

435. / (tan -1 — ) dx = atan -1 — — — log (a 2 + a 2 ), 
y V aJ a 2 

436. / (cot -1 — ) dx = acot -1 — + — log (a 2 + a 2 ). 
J V a/ a 2 

437. y a sin -1 (aa) da = ^— j ^(2a 2 a 2 — l)sin -1 (aa) + ax^J\ — a 2 a 2 ^ . 

438. /acos -1 (aa) da = — ^(2a 2 a 2 — l)cos -1 (aa) — ax^Jl — a 2 x 2 ^ . 

/a n+1 a C a n+1 
a n sin - (ax)dx= -sin - (aa) / , = da, n ^ — 1. 

V y n + 1 V y Ji + lj VI - a 2 a 2 

440. / x n cos -1 aa da = — — - cos -1 (aa) H — - / , = = da. n ^ — 1. 

7 n + 1 v ; n + lj VI -a 2 a 2 



441. / atan 1 (ax) dx = — a X tan 1 (aa) 
i 2a 2 

442. / a n tan -1 (aa) da = — tan -1 (aa) — / — - — - 

J n + 1 n + 1 J 1 + a 2 

f i , , 7 1 ~f" ax i , * a 

443. / acot (ax)dx = — cot (aa) H . 

J y ' 2a 2 y ' 2a 

444. f a n cot -1 (ax)dx = - — -cot -1 (aa) H ^— /" — - 

7 v y n+1 v ; n + 1 J 1 + a 2 : 

... f sin -1 (aa) , . f 1 — Vl — a 2 x 2 \ sin -1 (aa) 

445. / ^ — - dx = a log 1 1 

J x 2 



446 



/cos (aa) , 1 _i , . , ( 1 + Vl — a 2 a 2 \ 
~ — 1 da = cos (ax) + a log . 
a 2 a \ a / 
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447 
448 



f tan" 1 
J x< 



(ax) 



da = tan 1 (ax) 



a , ( 1 + a 

2 l0 H~ 



/ 
/ 
/ 



(aa) 



dx ■ 



1 ■ -1 
[sin 


(ax)) 2 dx 


(cos -1 


(ax)) 2 dx 


/ . -1 
[sin 


(ax)) n dx 


/ . -l 
(sin 


(ax)) n + 


or 





-— cot 1 (ax) — — lo 
x 2 

/ • -1 / \\2 



1 + a 2 a 5 



2^1 - a 2 x 2 



■ sin 1 (ax). 
cos -1 (ax). 



(sin" 1 (ax)) n + "V 1 ^!fl ( sin -i (ax))™- 1 - n(n - 1) f (sin" 1 (m))"" 
a J 



LfJ 

E 



(-1)""! 
(n-2r)! 



;(sin- 1 aa:) n - 2 '' + ^ (-l) r 



n!%/l — a 2 x 2 
(n-2r-\)\a 



(sm aa) 



452. J (cos -1 (aa:)) n da: 



a(cos 1 (ax)) n 



zVl - a 2 



or 

LfJ 

E 



-(cos 1 (aa)) n 1 — n(n — 1) / (cos 1 (ax)) n 



(n- 2r)! 



/ — 1 \r 

a: (cos ax) 



r=0 

._, , sin -1 , 1 / . _i N 2 
453. / — dx = — (sm ax) 

2a v ' 



y ( _ ir n!Vl -aV t 

^ v Mn - 2r - l)!a v y 



'/ 

/" a:" sin" 1 , 
' J VI - a 2 : 



■ da : 



■ y/l — a 2 x 2 sin 1 aa + 



=7 



, cos aa 1 , _i 

455. / = da = — — (cos aa) 

2a 



456 

457. 
458. 



/ 

/x n cos 1 
VT^ 2 



x sm ax 
%/l — a 2 x 2 



%/l — a 2 a 



2 ^2 

aa 



da : 



■ y/l — a 2 x 2 cos 1 ax ■ 



x 

n 2 a 
n — 



+ - 



na 



tan 1 aa, \ , _i 

1 ■ 2 2 ^ = T" ( tai1 aX > 

1 + a 2 a 2 2a v ' 



■ dx = — — (cot 1 aa) 



/• cot" 1 
./ 1+a 2 

459. / asec -1 axdx = sec -1 ax — -r—^y 1 a 2 x 2 — 1. 

./ 2 2a 2 

/■„-!. ^ + 1 -1 1 /' 

/ a sec aa da = sec aa / = 

J n + 1 n + 1 J Va 2 a 2 - 1 

/sec -1 



460 
461 



2a 

_2 



da. 



sec 1 aa \/a 2 x 2 — 1 
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462 . / x esc 1 axdx = — esc 1 ax 



463 
464 



I' 
J- 
I- 



2a? 



esc 1 axdx 



■ dx ■ 



.n+l 



n + l 



ax H / = 



dx. 



5.4.18 LOGARITHMIC FORMS 

465. j log £ da: = x log £ — a:. 

/x 2 x 2 
x log a: dx = — log a — . 



467 
468 



. J x 2 log x dx = ^- log 
. y a n lo. 



a; 



%xdx = log a 



n+l"" " (n + l) 2 ' 
469. y (log a) 2 da = a (log a) 2 — 2a log a + 2a 

a 



da = < 



(log x) n — n j (loga) n 1 da, n ^ — 1, 
or 

(-loga) r 



da : 



(-1)"»!*E 

1 sn+1 



n ^ -1. 



n + l 



(loga)" +1 , n^-1. 



470. y (loga) n 

471. /M^T 
./ a; 

/"da . (log a) 2 (log a) 3 

472 7 ^ = log (log ^ + log * + W- + St + • • • • 
473 7^ =log(log " ) - 

/" da _ 1 1 

7 a(loga) n (1 - ^(loga)"" 1 ' " 

f x m dx _ a m+1 m + 1 f a" 1 da 

J (loga) n ~~ (1 - nXloga)"- 1 n-lj (loga)"" 1 ' " 
^+1(1 )n n , 

— — / a (log a) da, 

m + 1 m + 1 J 

. I a m (log x) n dx 
477 y a; p cos (6 log a) da 



474 
475 



476 



m + 1 
or 

it' 



v y m + 1 ^ 



m + 

„p+i 



(-loga) r 
r!(m + l) n " 



/ 



478. / x p sin (6 log a) da : 



(p + 1) 2 + 6 2 

x p+1 
(p + 1) 2 +6 2 



[6 sin (6 log a) + (p + 1) cos (6 log a)] . 



[(p + 1) sin (6 log a) — b cos (6 log a)] . 



/ax + 6 
log (ax + b)dx = log (ax + 6) — a. 
" 
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og (ax + b) a 



ax + b . 



480 j log y ^ , - j _ j , + ^ 

J x 2 b 



481 



482 



/ ^ 10 



>g (aa + 6) da: : 



m+ 1 



bx 

m+l 



log (aa + 6) 



(, \ m+l m+l 



1 / ai\ r 



/ 



log (aa; + 6) 



da : 



1 log (ax + b) 1 



m— 1 a m_1 



m + 1 \ a 

i(-f) 



lo. 



r=l 

aa + 6 



1 / ax— i ^1/ 6 V 

+ 7 ~r ? . m>2 - 



a ~l~ a 

483. / log dx = (x + a) log (a + a) — (a — a) log (a — a). 



/log 
. j x m lo, 



a — a 
a + a 



-m+l 



da : 



a — a 



m+l 



(-a) m+1 , . . a m+1 - a m+1 , . 
- - : log (x + a) — log (x — a) 



m + l 



2a m+1 L ^ J 1 /ay 
+ m + l ^ m-2r + 2W 



485 



/l a + a 
— log 
a 2 a — a 



, 1 , a — a 1 a 2 — a 2 
da = - log — log — . 

a x + a a x z 

For the following two integrals, X = a + bx + cx 2 
486. y log X da = 

r / fi \ . \/4ac — fi 2 

tan 



V4ac 


-b 2 


c 


V6 2 - 


4ac 



tanh 



487 
488 



a+-jlogX-2a + 
or 

a + ^logX-2a + 

. / a n logXda = — -\ogX--^- f 
J 8 n + 1 6 n + 1 ./ 

/log (a 2 + a 2 ) da = a log (a 2 + a 2 ) — 2a + 2a tan -1 — 
a 



%/4ac — b 2 ' 



%/6 2 — 4ac' 



b 2 - 4ac < 0, 



6 2 - 4ac > 0. 



2c /" a"+ 2 

-—da 

X n 



„i+i 



X 



■ da, n ^ — 1. 



a + a 



489. / log (a 2 — a 2 ) dx = x log (a 2 — a 2 ) — 2a + a lo; 

490. j x log (a 2 + a 2 ) da = ^ (a 2 + a 2 ) log (a 2 + a 2 ) — ^ 
491 



x — a 

2 



. y log ^a + ^/ x 2 ± a 2 ^ da = a log ^a + ^/ x 2 ± a 2 ^ — ^/x 2 ~±~a?. 

/( t \ ( a 2 a 2 \ / / \ X's/x 2 i a 2 
a log ^a + v^ 2 =t fl2 J da = I — ± — J log ^a + x 2 ± a 2 J . 

y x m log ^a + ^ x 2 ± a 2 ^j dx = X ^ ^ log ^a + \/a 2 ± a 2 ^ 



493 



494 



/ 



m + l J Va 2 ± a 2 

log (a + Va 2 + a 2 ) log (a + %/a 2 +a 2 ) 1 a + %/a 2 + a 2 

■ dx — 



dx. 



-log- 

a 
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log (a + %/a 2 - a 2 ) log (a + %/a 2 - a?) 1 _ 1 x 
495. / dx = + — sec — . 



/x" log (x 2 — a 2 ) dx = 
& v ; n+1 



x log (x — a ) — a log (x — a) 

LfJ 

-(-af+Mog (a + a)-2^ 



n - 2r + 1 



5.4.19 EXPONENTIAL FORMS 

497. y e^da^e*. 

498. f e~ x dx = -e~ x . 



'•/ 
'•/ 
»■/ 



499. / e a * dx : 



500. are da: : 



501. / a m e a:c da = < 



-(aa- 1). 



/a e da, 

a a J 



or 



! E(- 1 ) r 



r=0 



(m — r)!a r+1 



M ,2. / _da = loga + - + — + — + . 

1 e ax 
503. / — da = ^— r + 

a m 1 — m x rn 1 



'•/ 



504 
505 
506 
507 

508 

509 
510 
511 



/e ax log a da = 2fL£ / f — d x 
a a J x 

f dx 



a f e ax 

— - / 7 da, m ^ 1. 

- 1 / a" 1 " 1 



J^L^ = -- L Jos(a + be^ 



/ 
/ 



+ be px a ap 
dx 



ae mx + fe- 



- tan -1 f e m:c / — 
mVa6 V V b 

1 , ( y/Ze r 

:l0g 



da 



■6e" 



a > 0, b > 



./ (a»-a-) 



or 

=tanh _1 I \l—e" 

mVab V V o 



a > 0, 6 > 0, 



a > 0, 6 > 0. 



da : 



a + a 
log a 



e ax 1 
— — — da = — log (6 + ce ax ). 
b + ce ax ac 



/xe 
(TT 



aa) : 



• da : 



a 2 (l + aa) 
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/ 



512. / xe x dx 



1 -J 

r ■ 



513. J e ax sin (6a;) dx 

514. J e ax sin (6a;) sin (cx) dx 



e ax [a sin (6a;) - 6 cos (6a;)] 
a 2 + 6 2 ' 
e a:c [(6 — c) sin (6 — c)x + a cos (6 — c)x] 
2 [a 2 + (6 - c) 2 ] 

e ax [(6 + c) sin (6 + c)x + a cos (6 + c)x] 



515 



. y e a:c sin (6a:) cos (cx) dx 
516. J e ax sin (6a:) sin (6a: + c) da: 



2[o 2 + (6 + c) 2 ] 
e ax [asm (6 — c)x — (6 — c) cos (6 — c)x] 



+ - 



517 
518 



. J e ax sin (6a:) cos (6a: + c) dx ■ 
. J e ax cos (6a;) 



2 [a 2 + (6-c) 2 ] 

e ax [a sin (6 + c)x - (6 + c) cos (6 + c)x] 
2[a 2 + (6 + c) 2 ] ' 
e a:c cos c e a:c [a cos 26a: + c + 26 sin 26a: + c] 
2^ 2 [a 2 + 46 2 ] ' 

e ax sin c e a:c [a sin 26a: + c - 26 cos 26a: + c] 



2a 



2 [a 2 + 46 2 ] 



a 2 + 6 2 



[a cos (6a:) + 6 sin (6a;)] . 



519. / e ax cos (6a:) cos (cx) dx 



e ax [(b — c) sin (6 — c)x + a cos (6 — c)x] 



520. J e ax cos (6a:) cos (6a: + c) dx 

521. y e ax cos (6a:) sin (6a: + c) da: 
^ e a:c sin n (6a:) da: 



2 [a 2 + (6 - c) 2 ] 

e a:c [(6 + c) sin (6 + c)a: + a cos (6 + c)x] 
2[a 2 + (6 + c) 2 ] ' 
e aa: cos c e aa: fa cos 26a: + c + 26 sin 26a: + c] 



+ 



2a 



+ 



2 fa 2 + 46 2 1 



522 



1 



a 2 + n 2 6 2 



J e ax cos n (6a;) da: 

/ 

/m a 



l 



a 2 + n 2 b 2 



524. I x e smxdx=—x e (sini-cosi 



e ax sin c e a:c [a sin 26a: + c — 26 cos 26a: + c] 
2~a + 2 [a 2 + 46 2 ] ' 

[(asin (6a:) — n6cos (bx))e ax sin n_1 (6a:) 

+n(n — 1)6 2 J e ax sin n_2 (6a:) da: 

[(acos (6a:) + n6sin (bx))e ax cos n_1 (6a:) 

+n(n - 1)6 2 J e ax cos n_2 (6a;) da: 

)- T y* e 



sin x dx 
m 



/m— 1 x 
x e 



cos a: da:. 



sin 6a: da: = x m e 



ax a sin (6a:) — 6 cos (6a:) 



a 2 +b 2 
m 



a 2 +b 2 

526. / x m e x cos x dx = -x m e x (sinx + cosx) — — 
J 2 y '2 



I 



527. / x m e ax cos 6a: da: = x m e 



, x a cos (6a:) + 6 sin (6a: 



J x m 1 e ax (asin (bx) — 6 cos (6a:)) da:. 

/m— 1 x • » 
a: e sin a: da: 

^ / m— 1 x 

--y, e, 



cos a: da:. 



a 2 + 6 2 
m 

" a 2 + 6 2 



y a: m 1 e a:c (acos (6a:) + 6 sin (6a:)) da:. 
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/ax 
e 



OO / ax m Tl i 

528. / e cos ism a da 

ax { -.-.^m — 1 



e ax (cos m a:) (sin™ a) [a cos a + (m + n) sin x] 
(m + n) 2 + a 2 

I ax i m—l w • n— 1 \ » 

— : / e (cos i sin x)dx 

{m + n) 2 +a 2 J y Jy ' 

(m-l){m + n) f _ ax ,__m-2 . 



(m + n) 2 + 



■A f 

a 2 J 



ax / m — 2 \ / • n \ i 

e (cos a) (sin a) da, 



or 



e ax (cos m x) (sin™ 1 x) [a sin x — (m + n) cos x] 



+ 



(m + n) 2 + a 2 

TTld I a x / m _i * , n— 1 



/ 



ax/ m—l w • n— l \ i 

e (cos a J (sin x ) ax 



(m + n) 2 + a 2 

(n- l)(m + w) f ax , m . , . n _ 2 . , 

+ ^ T" / e ( cos z)(sin a) da, 

(m + ny + a J 



or 



e ax (cos m 'a;) (sin™ 1 x) [a sin a cos a + msin 2 x — ncos 2 x] 



+ 



(m + n) 2 + a 2 

1Tl{7Tl 1) I ax / m — 2 w • n \ » 

7 1 r~r — —^r I e (COS I sin x) ax 

(m + n) 2 +a 2 J y A y 

+ , "i"" 1 ] 5 / e^(cos m a)(sin' l - 2 a)da, 
(m + n) 2 + a 2 J 



or 



e a:c (cos m 1 a)(sin n 1 a) [a sin a cos a + msin 2 a — ncos 2 a] 
(m + n) 2 + a 2 

+ , ~ 1} , /e^(cos m - 2 a)(sin' l - 2 a)da 

(m + n) 2 + o 2 J 



+ 



(n — m) (n + m — 1) 
(m + n) 2 + 



L^l) fax 

a J 



(cos m a) (sin™ a) da. 



529 



. J xe ax sin (6a) da = 
530. J xe ax cos (6a) da : 



a 2 +6 2 



a 2 +b 2 



[a sin (6a) — 6 cos (6a)] 



(a 2 +6 2 )" 



[(a 2 — 6 2 ) sin 6a — 2a6cos (6a)] 



[a cos (6a) + 6 sin (6a)] 



(a 2 +6 2 ) 2 



[(a 2 — 6 2 ) cos 6a + 2a6sin (6a)] 



531 
532 
533 



f e ax 
J sin" a 

/^d 

y cos n a 

/ax , n 
e tan 



e a:c [a sin a + (n - 2) cos a] a 2 + (n - 2) 



+ • 



(n-l)(n-2)sin n - 1 a (n-l)(n-2) 
e a:c [a cos a - (n - 2) sin a] a 2 + (n - 2) 



+ 



(n- l)(n - 2)cos n " 1 a (n-l)(n-2) 



J sin n " 2 

/"_£!! 

y cos n ~ 2 



■ da. 



■ da. 



xdx = e a 



n — 1 n 



/ax , n— 1 j I ax 

e tan xdx— I e 



5.4.20 HYPERBOLIC FORMS 

534. y sinh xdx = cosh a. 

535. y cosh a da = sinh a. 
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536. J tanh xdx = log cosh a. 

537. j coth xdx = log sinh x. 



538. j sech a da = tan -1 (sinh a:) 

539. j csch a da = log tanh (J^J- 
. J a: sinh; 

541. J x n sinh a: da = x n cosh a — n J x n_1 (cosh a) ( 

/< 

J x n cosh a dx = x n sinh a — n j a" -1 (sinh a) dx. 

/' 
/< 
/' 

f sinh" 



540. / a sinh xdx = a cosh a — sinh a. 

) dx. 

542. / ;ccosh xdx = ;csinh r - coslix. 
543. 

544. J sech a tanh a da = — sech a. 

545. f csch a coth a da = — csch a. 

, , . ; . , 2 , sinh 2a a 

546. / sinh xdx = — — . 

547. / sinh m a cosh" xdx = 



548 



/ 



+ n m + n J 

or 

sinh m_1 acosh n+1 a — — / sinh m_ 2 a cosh" a da, m + n ^ 0. 

+ n m + n J 



m + n 
or 



m + n 

da 



(sinh m a)(cosh n a) 

1 m + n — 2 f dx , 
— / da 

(m-l)(sinh m - 1 a)(cosh n - 1 a) m-1 J (sinh™" 2 a)(cosh n a) ' 

or 

1 m + n — 2 f dx , 

-L / (XX 

(ra-l)(sinh m - 1 a)(cosh n - 1 a) n-l J (sinh m a)(cosh n " 2 a) ' 



/tanh" a da = 1- / (tanh n_ a) da, n ^ 1. 
n-l J 

/' 
/■ 
/■ 

554. / coth" xdx = 1- / coth" -2 a da, n ^ 1. 

./ n-l J 



551. / sech xdx = tanh a 



. ,2 j sinh 2a a 
552. / cosh xdx = ■ h — 
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555. J csch 2 xdx = — coth a. 

556. J (sinh. mx) (sinh. nx) dx - 

557. j (cosh mi) (cosh nx) dx ■ 



sinh (m + n)x sinh (m — n)x , , , 

-, m ^ n . 



2(m + ra) 



2(m — n) 



sinh (m + n)x sinh (m — n)a 



2(m + n) 



+ 



2(m — n) 



558 



j (sinh mx) (cosh na) da: : 



cosh (m + n)a cosh (m — n)a 



2 / 2 

m ^ n 



2 / 2 

m n 



2(m + n) 2{m — n) 

559. / (sinh -1 — ] dx = a: sinh -1 — — x 2 + a 2 , a > 0. 
J V as a 

560. / x (sinh -1 — ) dx = ( — — h — | sinh -1 — — —^Jx 2 + a 2 , a > 0. 
J V a/ \ 2 4 / a4 

561. y a n sinh -1 a dx 



■ sinh 1 a , 

n+l n + 1 J y^l + x 2 



hi 



dx, n ^ —1. 



562 

563 
564 
565 



cosh 1 — dx 



I 

.|a(cosh -1 i) 
J x n cosh -1 

/K3 



zcosh 1 V ' z 2 — a 2 , cosh 1 ^ > 0, 

or 

2: cosh -1 - + V« 2 - a 2 , cosh -1 * < 0, a > 0. 
a a 

2 



da : 



a a \ , -1 a a /- 
— — cosh TV 2 



a 



x dx ■ 



x 



n+l 



■ cosh 1 a ■ 



hi- 



x 



n+l 



n + l ~ n + lj V« 2 - 1 

-ii . «, / 2 2 



da, n ^ —1. 



da = a tanh 1 — + — log (a —a), |f|<l- 



567 
568 



566. / fcoth -1 -) da = acoth -1 - + |log (a 2 -a), N > 1 
./ V a / a 2 1 a 1 

// , -1 i\ , a 2 — a 2 , -1 a aa , _ , 
a tanh - da = tanh - + — , - < 1. 
V a) 2 a 2 ' 1 a 1 

/x n tanh -1 a da = — tanh -1 a / — 
n+l n+lj 1 

569. J x ^coth -1 — ^ da 



-n+l 



da, n ^ —1. 



a 2 — a 2 . _i x ax 

coth - + — , 

1 a 1 



> 1. 



/" _i a n+ _i 1 f x n+ 

570. / x n coth ada = -coth aH / — -di, 

7 n + l n + 1 ./ a 2 - 1 ' r 

571. J sech -1 a da = asech -1 a + sin -1 a. 

572. j x sech - 1 a da = ^- sech - 1 a — ^ \/l — a 2 . 

/a n+1 1 /" a n 
a n sech -1 a da = -sech -1 a H / da, n ^ — 1. 

n + l n + 1 ./ yT^ 2 



574. /csch -1 ada = acsch -1 a+^sinh -1 a. 

575. / a csch - 1 a da = — csch - 1 a + — -^-r ^/l + : 
.7 2 2 |a| 
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/X 1 x f x n 
x n csch~ 1 xdx = -csch _1 :rH -77 / dx, -1. 

n + l n + l\x\J •JT+tf 

5.4.21 BESSEL FUNCTIONS 

Z p (x) represents any of the Bessel functions { J p (x), Y p {x), K p {x), I p (x)}. 

577. J x p+1 Z p (x)dx = x p+1 Z p+1 (x). 

578. J x- p+1 Z p (x)dx = -x'^Zp-^x). 

579. / x[Z p (ax)] dx = — [[Z p (ax)] — Z p -\(ax)Z p +i(ax)] . 
. J Z x {x)dx = -Z (x). 
. J xZo(x)dx = xZi(x). 



580 
581 



582 
583 



5.5 TABLE OF DEFINITE INTEGRALS 

/•CO 

/ x n ~ 1 e~ x dx = r(n), Ren>0. 
Jo 

f°° _ n\ 

I x n p x dx = -r p > 0, n is a non-negative integer. 

Jo (logp)"+ 1 

584. [°° x n - 1 e- (a+1)x dx= , F(w) , , n>0, o>-l. 
Jo (a + l)" ! 

585. f 1 x m ( log - V dx = /^t 1 !, , m > -1, n > -1. 
7o V x) (m + l)»+ 1 ' 

586. / a; (1 — x) dx = I 7- r — : — = — - — —r, n > u, m > v. 

Jo Jo (l+z) m+n r(m + n)' 

587. Jjx-a) (b-x) dx=(b-a) r(m + w + 2) ' 

m > —1, n > — 1, b > a. 

.00 r dx 1 

588. / = -, m > 1. 

J 1 x m m-1 



I (TT^ = " cscp7r ' 0<p<1 ' 
f°° dx 

/ T\ w = -Tcotfwr, 0<p<l. 

y (1 _ X )p dx = p ncsc P n > \p\ < !• 

r 1 r 1 (1 _ a;)p 

592 - J (1 _ a;)p+i da: = y o ^+1 da: = -"-cosecpTr, -1< p < 0. 

/•CO p— 1 

593. / I dx=^— , 0<p<l. 

Jo l + x smp7r 



589 
590 
591 
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594. 



o l + x n 



■ dx - 



< m < n. 



595. / —!-^dx=™ 



596. f 

Jo 



r 

J (m + x b ) c 
dx 



a+l-bc)/b ^ p^ c _ a+1 ^ 

~b " r(c) 



a > -1, 6 > 0, m > 0, c> 2±1. 



597 



(l + x)v^ 

/•CO ^ 



da: = < 



7T 

2' 


o 


>0, 


or 






0, 


o 


= o, 


or 






7T 

2' 


o 


< 0. 



598 



599 



f 1 < 2 2\"/ 2 , f 1 1 / 2 2\« 

/ (a — i ] dx = I — (a — x ) 

JO J -a ^ 

f 1 m I 2 2\"/2 j 1 

I x (a — x ) dx = —a 
Jo 2 



da: 



71!! 7T n+ i 

r^a , 



(n+l)!! 2 
a > 0, n is an odd integer. 



1 r/ m+l \ r / n+2 \ 

_m+n+iiUJiUi j a > 0, m > -1, n > -2. 



600. /" 7 sin n :rd:r = f 
Jo Jo 



r/2 



cos n x dx = < 



p ^ m+n+3 ^ 

2 rm > 

or 

(re - 1)!! 71- 

re!! 2' 
or 

(re - 1)!! 



71 > -1, 

re ^ 0, n is an even integer, 
n ^ 1, re is an odd integer. 



f 

■Jo 

■f 

■Jo 

F 

■Jo 
■Jo 



■ dx = < 



7T 

2 


5 


a 


>0, 




or 






0, 




a 


= 0, 




or 








7T 




< 0. 






a 




2' 







■ dx = oo. 



tan x , 7T 
603. / dx = -. 

• 2 



... , , tanaa , 7r 
604. / dx = -, a > 0. 

x 2 



605. / sin (tm:) sin (mi) dx = I cos (re:r) cos (mi) di = 0, 
Jo Jo 

n ^ m, re is an integer, m is an integer. 

p-k / n p-k 

606. / sin (nx) cos (ra) dx = sin (nx) cos (ra) da: = 0, re is an integer, 
io Jo 

a — b is an odd integer. 



607. / sin ax cos bxdx = < 



2a 



a 2 - 6 2 ' 
or 

0, a — 6 is an even integer. 
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..... , sin a cos aa , 
608. / dx = < 



609 



610 



612 
613 
614 

615 

616 
617 
618 
619 
620 
621 
622 
623 
624 
625 



/■OC 

*/ 

Jo 

POC 

Jo 

pn 

Jo 

J 

Jo 

J 

Jo 

■/ 

Jo 

[°° I 

Jo 

I 



sin ax sin bx 



x* 



sin mx dx 



dx = < 



0, 

or 

7T 

4' 

or 

7T 

2' 
7ra 

T' 
or 

nb 

T' 



H>i, 

|a| = 1, 

|a|<l. 
< a < 6, 

< 6 < a. 



/ cos mi dx = —, m is an integer. 



6n. r^^dx = ^M. 



a: 
sin £ 

a^ 
cos a: 
a^ 



dx - 
dx 



2T(p) sin(p7r/2) 

7T 



2r(p) cos(ptt/2) 



, <p < 1. 
, <p < 1. 



cos pa , 7r p 

x 2 2 



sin pa cos qx 

x 



■ dx ■ 



dx = < 



or 



7T 

2' 

7T 

4' 



or 



2|a| 



) da = 
I da : 



na 1 /" 
1 

' cos a 



poo t- 

. I cos a 2 da = / 
io Jo 

poo 

/ sin (aa n ) 
Jo 

POO 

. I cos (ax n 
Jo 

f°° sina ^ _ f 
Jo V% Jo Vx 

■L 
■L 
L 
■L 

p-k/2 

Jo T 



sin a da = - < / — 
2 V 2 



g > p > 0, 
p > g > 0, 

p = q > 0. 

i pa 



\fx 




sin 3 


x 


a 




sin 3 


X 


a 2 




sin 3 


X 


a 3 




• 4 

sin 


X 



r 
r 

da : 



sin — , n > 1. 

2n' 



cos — , n > 1. 
2n 



4' 



3 
4 

3tt 



da = — log 3. 

da : 



da 
+ a cos a 



7T 

3' 
■ da : 



lal < 1. 
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626 



/*7T 

Jo 



dx 



■ dx 



o + 6cosa Va 2 - 6 2 ' 



627. / — da: 



/" d. 

' ./o 1 + a 

L 



2tt 



cos ax — cos 6a: 



dx = log 



a > b > 0. 



lal < 1. 



629 



r> 2 dx_ 

J a 2 sin 2 x + b 2 cos 2 x 2 |a&| 

dx 



■ dx ■ 



' Jo (a 



sin x + b 2 cos 2 a) 2 



7r(a 2 +6 2 ) „ , „ 

dx = \ — a > 0, b > 0. 
4a ^ 



631. / sin"" 1 aces™" 1 ada = y , 



m is a positive integer, n is a positive integer. 



r /2 • 2n+i , (2n)!! ... 

632. / sin T ada: = 7 - i — -tttti n is a positive integer. 
Jo (2n + l)!!' 

Jo 
Jo 



. • • 2n , (2n-l)!!7T . ... 

633. / sin xdx = — — ; ,, — — , n is a positive integer. 



(2n)!! 2' 
1111 

l 2 ~ ¥ + S 2 ~ T 2 



634. / dx = 2 

sin a: 

635. / — — dx = — , m is a non-negative integer. 

+ tan m x 4 ' 



/■7T/2 

./o T 

636. / V cos a da 

r /2 

637. / tan a: da 
638 

639. f 

jo 



(27r) 3 / 2 



(r(i/4)) 2 



7—, < h< 1. 



2cos(Af) 

l""^ 2 tan -1 aa — tan -1 bx , 7r , a „ , 

. / da = - log -, a > 0, b > 0. 

Jo x 2 6 



e a:c da = — , a > 0. 
a 



640 



■da = log -, a > 0, 6 > 0. 



641 

642 
643 



e~ ax dx = t 



r(n + l) 

a n+l 

or 

n! 



,n+l 



r((n+l)/p) 



(n+l)/p ' 



/•oo 
/ *" 

Jo 

poo 

. I x e 

JO 

2 2 1 

. / e~ a x dx= — V7T, a > 0. 
Jo 2a 

644. / e~ ax2 dx = \J- erf (by/E), a > 0. 
Jo 2 V a 

645. ^ e"^ 2 da = iy^erfc (6V^), a > 0. 



, a > 0, n > -1, 

a > 0, n is a positive integer. 



o > 0, p > 0, n > -1. 
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L 
L 
L 
■L 

■s: 



xe x dx 



2 -X 2 , V™ 

x e ax = ——. 



In -ax 2 , _ (2n - 1)!! pK 



648. x e dx 



649. I x 2n+1 e- ax dx 



2{2a) n V a 



a > 0, n > 0. 



a > 0, n > -1. 



650. / 



1 -a 

1 " e Z^TT 



651 
652 



/ 2 2 , 2\ 

^(-x -a fx ) 



■f 

Jo 

J°° e (-ax 2 - b/ x 2 ) dx = 1 y| e - 2 ^, a > 0, 6 > 0. 



653. / v^ e a ^ ^ : 



1 /tt 



/•co —ax 

654. / —=dx -- 
Jo Vx 

poo 

655. / e~ ax cosmxdx 
Jo 



2a V a 

7T 



, a > 0. 
a > 0. 



a 



a 2 + m 2 ' 



a > 0. 



/"°° -or /, x , a cose — b sine 

656. / e cos (6a; + c) dx = - , a > 0. 

Jo ' a + b 2 



657 



f 

jo 



e sin ma da : 



o 2 + m 



2 ' 



a > 0. 



*=e /°° -of • ci. , u 6cosc + asinc 

658. / e sin (bx + c) dx = — , a > U. 

Jo a 2 +b 2 



a 2 — b 2 

660. / xe~ ax cos bxdx = , „ _ ,„.,„ , a > 0. 



661 



662 



663 



665 



666 



I 

L 

pOO 

■ / x 

Jo 

poo 

/ x 

Jo 

■L 

[ 
f 

Jo 

■f 

Jo 

/•oo 

/ 6-1 
/ X 

Jo 



xe ax sin bx dx ■ 



2ab 



(a 2 +6 2 ) 2 



a > 0. 



(a 2 +6 2 ) 2 ' 



e ax sin bx dx ■ 



e ax cos bx dx 



[(a + ib) n+1 - (a-ib) n+1 ] 



+ i 



2i(a 2 +b 2 ) n 
[(a - ib) n+1 + (a + ib) n+1 ] 



X 
2 2 



2(a 2 +b 2 ) n + 1 
dx = cot -1 a, a > 0. 



, a > 0. 



, a > 0, n > -1. 



\/7r -./ I.-. 2 
2 a 



6/(4a \ a6>0. 



-x cos <i fe— 1 



a" sin (a sin da = T (6) sin (6<?!>), b > 0, -f <<?!>< f. 



-x cos 6—1 



a cos (a sin <?!>) da = cos (6<?!>), b > 0, -f <<?!>< f. 



for 



cos a da = r(6) cos ( — ) , < 6 < 1. 
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668 
669 



sin a dx = Y(b) sin ( ^ ) , < b < 1. 



671. 
672 



673. / alog(l + x)dx = -. 



674 
675 
676 



C-irrfn + i) , . 

dx = , . J\ ... , , , m > — 1, n is a non-negative integer. 



(m + 



/•oo 

/ 6-1 
. / X 

Jo 

f {\ogx) n dx={-\) n n\, n>-\. 
Jo 

™.f o f^-dx=^-. 

Y 

I dx = n\. 
Jo \ X J 

f 1 3 
. / a: log (1 — x) dx = — — . 
Jo 4 

/ xlo, 
Jo 

. I x (log a:) 
Jo 

r h 

'Jo 1- 

■a 

L 
■L 

rl 2 

679. / (loga)log(l+a)da = 2-21og2- — . 
Jo 12 

■ /'(log 

JO 

Jo 1 



og a: 
+ a 
log X 



dx = — — . 
x 6 



677. C^±^dx=*-. 
x 12 

678. f 1 l °^-^dx = -^. 
x 6 



680. / (log x) log (1 - x) dx = 2 - — 



log a 



f\ fl+x\dx 7T 2 

68 \/ 1o Ht^J- = t- 

rjm^dx 

Jo 



683. 
684. 
685. 
686. 



-flog 2. 



f 1 




/ x 


[* (:)] 


Jo 




f 1 x p - 


- a" 


da = 


Jo lo i 


; a 



da 



_ r(n+l) 
~ (m+ l) n+1 
p+ 1 



m > —1, n > — 1. 



da 



9 + 1 



p> -1, q> -1. 



7T 
T 



/'- _ 

Jo ^logt-loga) 

687 -r i0g (^r)^ 

688. / log sin a da = / lo 

Jo Jo 

/■Tr/2 /■t/2 

689. / log sec a da = / 1 

Jo Jo 



>g cos a da 



"2 log 2. 



log cosec a da = — log 2. 
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690. / a log sin a: da: = — ^- log 2 



691 



; sin x dx = log 2 — 1. 



. / alo, 
Jo 

/ (sin x) lo, 

/■tt/2 

692. / log tan x dx = 0. 
Jo 

693. / log (a ± 6 cos a) da = 7r log 
Jo 

694. / log (a 2 — 2abcosx + b 2 ) dx 
Jo 



+ Va 2 - 6 2 



, a > 6. 



27rloga, a > b > 0, 
or 

27rlog6, 6>a>0. 



/"°° sin aa , n .an 
695. / — — da = — tanh — — . 
J sinh 6a 26 2 |6| 

cos aa 



696 
697 
698 



■f 

■Jo 

■f 

■Jo 

./• 

JO 



, 7r , nir 

r~r~ dx = — seen — . 

cosh bx 26 26 

da n 



cosh ax 2\a\ 

~ r" da = -, a > 0. 

sinn aa 4a 2 



699. / e~ ax cosh (6a) da : 



■r 



6 2 ' 



e a:c sinh (6a) da 



a 2 - 6 2 ' 



701. 


Z" 00 sinh ax , 

/ — r r da = 

/„ e te + 1 


7T 

26 


an 1 

CSC — — 

6 2a 


702. 


Z" 00 sinhaa 
/o e te - 1 


1 

2^ 


7T 

~ 26 


an 
cot — 
6 


703. 


r /2 da 




7T 


H 


Jo -\/l — k 2 sin 


2 a 


~ 2 



|6| < a. 
|6| < a. 
, 6> 0. 



-G) V+ (H) V+ (^) V+ 



p-k/2 

704. / 

jo 



da 



(1 -/c 2 sin 2 a) 3 / 2 2 



1 + ( - ) 3k 2 + 



1 ■ 3 

2 • 4 



+ 



(— Y 



7F + . 



fc 2 <1. 



k 2 <1. 



705 

706 
707 
708 



./"V 

JO 



1 — k 2 sin a da : 



1 ■ 3\ 2 k 4 

2 • 4 



/ 1_3_5\ 2 F 
^2-4-6^ 5 



poo 

/ e~ x log a da = —7. 
jo 

/ e - * logada = -^-(7 + 2 log 2). 
Jo 4 

Jo VI -e~ x *s 



k 2 < 1. 



e da = 7. 
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5.5.1 TABLE OF SEMI-INTEGRALS 



/ 










1 

X 




x n , n = 0,l,2,... 


(n!) 2 (4z)" + 1/2 
(2n+l)!V? 


x p , p > -1 


r(p+l) T »+l/2 

r(p+|) a; 


s/l + x 


^Y" (1 + x) tan -1 (v 7 ^) 
V 7T v^ 7 


1 


^tan-^Vi) 


1 

e 31 erf {\fx) 
sin (i/ir) 
cos (v^) 
sinh {\fx) 
cosh (v^) 

cos(\/^) 


2sinh _1 ( v ^ : ) 

e x erf (\/a;) 

- 1 
y/ITXJi (\/x) 
s/TtxH-i (y/x) 

\pKX,I\ (\fx) 

\pKxL_i {\fx) 

\/ttH (y/x) 

\fnJo {\fx) 


log a; 


2y^ [\og(4x) - 2] 


log X 


V^log (f) 
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5.6 ORDINARY DIFFERENTIAL EQUATIONS 



5.6.1 LINEAR DIFFERENTIAL EQUATIONS 

A linear differential equation is one that can be written in the form 

b n (x)y^ + 6„_ 1 ( a; ) 2 /("- 1 ) + • • • + b^y' + b (x)y = R(x) (5.6.1) 

or p(D)y = R(x), where D is the differentiation operator (Dy = dy/dx), p(D) is 
a polynomial in D with coef c ients {bi} depending on x, and R(x) is an arbitrary 
function. In this notation, a power of D denotes repeated differentiation, that is, 
D n y = d n y/dx n . For such an equation, the general solution has the form 



y(x) = yh(x) + y p (x) 



(5.6.2) 



where yh(x) is a homogeneous solution and y p (x) is the particular solution. These 
functions satisfy p(D)yi l = and p{D)y p = R(x). 



5.6.1.1 Vector representation 



dy 



Equation (5.6.1) can be written in the form = A(x)y + r(x) where 

dx 



y 




' 


1 





" 




"0" 


y' 










1 










y" 


, A(x) = 










> r(a;) = 

















1 







y(n-l) 




L b„ 


bi 

b„ 


b 2 
b„ 


b„-i 
b n J 




R 
-b„- 



5.6.1.2 Homogeneous solution 

For the special case of a linear differential equation with constant coef cien ts (i.e., 
the {bi} in Equation (5.6.1) are constants), the procedure for nding the homoge- 
neous solution is as follows: 

1. Factor the polynomial p(D) into real and complex linear factors, just as if D 
were a variable instead of an operator. 

2. For each non-repeated linear factor of the form (D — a), where a is real, write 
a term of the form ce ax , where c is an arbitrary constant. 

3. For each repeated real linear factor of the form (D — a) m , write the following 
sum of m terms 



cie ax + c 2 xe ax + c 3 x 2 e ax + 



+ c m x m ~ 1 e ax 



(5.6.3) 



where the c,'s are arbitrary constants. 
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4. For each non-repeated complex conjugate pair of factors of the form 
(D — a + ib)(D — a — ib), write the following two terms 

c\ e ax cos bx + c 2 e ax sin bx. (5.6.4) 

5. For each repeated complex conjugate pair of factors of the form 
(D — a + ib) m (D — a — ib) m , write the following 2m terms 

c\e ax cos bx + C2e ax sin bx + czxe ax cos bx + c±xe ax sin bx + . . . 

+ c 2m -ix m ~ 1 e ax cos fez + c 2m x m - 1 e ax sin bx. (5.6.5) 

6. The sum of all the terms thus written is the homogeneous solution. 

EXAMPLE For the linear equation 

y m - Uy (6) + 81y (5) - 252 2 / 4) + 455y (3) - 474/ + 263y' - 60y = 0, 

p(D) factors as p(D) = {D - 1) 3 (D - (2 + i))(D - (2 - i))(D - 3){D - 4). The 
roots are thus {1, 1, 1, 2 + i, 2 — i, 3, 4}. Hence, the homogeneous solution has the 
form 

yh(x) = {Co + cix + cix ) e + (C3 sin x + ca cos x) e + c$e + c%e 
where {co, ... , c% \ are arbitrary constants. 

5.6.1 .3 Particular solutions 

The following are solutions for some speci c ordinary differential equations. In 
these tables we assume that P(x) is a polynomial of degree n and {a, b,p, q, r, s} 
are constants. In all of these tables, when using "cos" instead of "sin" in R(x), use 
the given result, but replace "sin" by "cos", and replace "cos" by "— sin". 
The numbers on the left hand side are for reference. 





If R(x) is 


A particular solution to y 1 — ay = R(x) is 


(1) 


e rx 


e rx l(r — a). 


(2) 


sin sx 


amnsx+scossx = ( a 2 + S 2 )~ 1/2 Sm (sx + tajl^ s ) . 


(3) 


P(x) 


a [ w a a J a" J 


(4) 


e rx sin sx 


Replace a by a — r in formula (2) and multiply by e rx . 


(5) 


P(x)e rx 


Replace a by a — r in formula (3) and multiply by e rx . 


(6) 


P(x) sinsx 


smsx[ a2 l s2 P(x)+ £-: 2)2 P'(x) 






k fk\ k-2 2 , fk\ fc-4 4 -1 

+■■■+* - G)a ( :^4 '--pc- 1 ) (*)+...] 






-co S sx[^P(x) + I ^ v P'(x) 






+---+ G)a ;- 2 ( + iV +...]. 


(7) 


P(x)e rx sinsx 


Replace a by a — r in formula (6) and multiply by e rx . 




continued on next page 
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continued from last page 


If R(x) is 


A particular solution to y — ay = R(x) is 


(8) 










e ax cos sx 


(9) 


c Sill SX 


s 


(10) 


P(x)e ax 


e ax f P(z)dz. 


(11) 


P(x)e ax smsx 


e^sinsa; \ P ' {x) P - {x) i P m (x) i ^ 






e»C08 M j p(a;) P^) + P^(£) + ] 





IfR(x) is 


A particular solution to y" — 2ay' + a 2 y = R(x) is 


(12) 


e™ 


e rx 

(r — a) 2 


(13) 


Sill sx 


(a 2 — s 2 ) sin sx + 2as cos sx 


(a 2 + s 2 ) 2 

1 . ( i 2as \ 
= sin 1 sx 4- tan 

or + s z \ a z — s z J 


(14) 


P(x) 


, + 2P <*> + + • • • + ( " +l)P „ W . 


(15) 


e rx sin sa; 


Multiply formula (13) by e rx and replace a by a — r. 


(16) 


P{x)e rx 


Multiply formula (14) by e rx and replace a by a — r. 


(17) 


P(x) smsx 


smsx[ T ^ 7 P(x) + 2$^P<(x) 

h (k\ k-2 2 ,(k\ k-4 A -i 

+■■■+(* i) a_G)a (a :; ( ^ a s -r^ 2 (,■)+..:_ 

+ cos sx [ J7 2 ^P(x) + 2fg^P'(x) 

+ ■■■+(* i) G)a s+ -p( k - 2 Hx) + ...]. 


(18) 


P(x)e rx sin sx 


Multiply formula (17) by e™ and replace a by a — r. 


(19) 


e ax 


2 


(20) 


e ax sin sa; 


S 2 ' 


(21) 


P(x)e ax 


e ax f J y P(z)dzdy. 


(22) 


P(x)e ax smsx 


_e« x smsx j p(x) _ 3P^) + + ] 
e a3: cossx p 2 p (a!) 4P"'( a: ) , ep' 5 '^) , 1 
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IfR(x) is 



A particular solution to y" + qy = R(x) is 



(23) 

(24) 
(25) 

(26) 

(27) 
(28) 



r z + q 
sin sx 



smsx 
P(x) 

e rx sin sx 

P(x)e rx 
P(x) sin sx 



e 2- 



l[p (a! )-^ + ^ + ... + (-l)*^ + ...]. 

(r 2 — s 2 + <j)e ra; sin sx — 2rse rx cossx 
(r 2 -s 2 + g) 2 + (2rs) 2 

: sin [sa; — tan -1 5 2r l 

[ r 2 — s 2 



yj{r 2 - s 2 + q) 2 + (2rs) 2 



3r -g 



[P(x) 

_ 

[(,-s 2 



/2fc+l\ 2fc , f2k + l\ „2fc-2 „ , 



sin 

H 

_ g cos s# 
<? — s 2 

+ ••• + (-1) 



9+H 

(q-s 2 ) 2 ^ W 



P"(x) 



f&X [ P ( x ) - -p^ P '{x) + ( q +r 2 ) 2 ' 

fk\ k-1 fk\ fc-3 , 

+ • • • + (-i)*- l (i)r '^" ^-^w + 



4s +4g p /// 



P"'(a;) 



jfc+i ( 2 i fc )' 



p(2*-l)( x ) + 



(29) 
(30) 



If R(x) is 


A particular solution to y" + b 2 y = R(x) is 


sin 6a; 
P(a;) sin bx 


x cos bx 
2b ' 

Bin** \p (x) P"M . P (4) M . 1 
_c-6.| ^ 



Ifi?(x) is 



A particular solution to y" + py' + qy = R(x) is 



(31) 

(32) 
(33) 

(34) 

(35) 



sinsi 
P(x) 



(q — s 2 ) sin sx — ps cos sx 1 / , — 1 r>s \ 

ssttxt^ = — ,0 sin (^sa; - tan J . 



P(x)e r 



(q-s 2 ) 2 + (ps) 2 ^/( 9 -s 2 ) 2 + (ps) 2 

I [ P(a;) _ £ P ' (a;) + i^P''(a;) - 

+ . . . + (-ir pn -^> n ~ 2q ^> n ~ 4q2 ---- p("Hx)] . 

Multiply formula (32) by e rx , replace p by p + 2r, and replace 

q by q + pr + r 2 . 

Multiply formula (33) by e rx , replace p by p + 2r, and replace 

q by q + pr + r 2 . 
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If R{x) is 


A particular solution to (D — a) y = R(x) is 


(36) 




e rx /(r - a) n . 


(37) 


Sill sx 


(a 2 +s 2)„ [^a (, 2 Ja s + ( 4 )a s ...)smsx + 






( in\ n—1 i ln\ n—3 3 , \ 1 

n i ja s+( g ja s J + . . . J cossa; . 


(38) 


P(x) 


(- 1 )" Td/ ^ i (n\ P'M . /n+l\ P"(x) . /n+2\P"'(x) , i 
(l) a + ( 2 )^*^+( 3 + ■■■]• 


(39) 


e rx sin sx 


Multiply formula (37) by e rx and replace a by a — r. 


(40) 


P{x)e rx 


Multiply formula (38) by e rx and replace a by a — r. 



5.6.1.4 Second-order linear constant coef cient equation 

Consider ay" + by' + cy = 0, where a, b, and c are real constants. Let m\ and m 2 
be the roots of am 2 + bra + c = 0. There are three forms of the solution: 

1. If m\ and m 2 are real and distinct, then y(x) = c\e miX + C2e m2X 

2. If mi and nii are real and equal, then y(x) = c\e miX + C2xe miX 

3. If nii = P + iq and m 2 = p — iq (with p = —b/2a and g = \/4ac — b 2 /2a), 
then y(a;) = e p3: (ci cos qx + c 2 sin ga;) 

Consider ay" + by' + cy = R(x), where a, 6, and c are real constants. Let nii 
and m 2 be as above. 

1. If nii and m 2 are real and distinct, then y(x) = Cie miX + C-2e m ' 2X 
+e mix /(mi - m 2 ) /* e - miZ R(z) dz + e m2X /(m 2 - nii) f e~ m2Z R(z) dz. 

2. If nii and m 2 are real and equal, then y(x) = Cie miX + C2xe miX 
+xe mix f e- miZ R(z) dz - e mix f ze~ m ' z R(z) dz. 

3. If nii = p + iq and m 2 = p — iq, then y(x) = e px (ci cos qx + c 2 sin qx) + 
e px sinqx/q J x e~ pz R(z) cosqzdz — e px cosqx/q J x e~ pz R(z) smqzdz. 



5.6.1.5 Damping: none, under, over, and critical 

Consider the linear ordinary differential equation x " + fix' + x = 0. If the damping 
coef cien t /x is positive, then all solutions decay to a; = 0. If = 0, the system is 
undamped and the solution oscillates without decaying. The value of fi such that the 
roots of the characteristic equation A 2 + fi\ + 1 = are real and equal is the critical 
damping coef cient. If [i is less than (greater than) the critical damping coef cient, 
then the system is under (over) damped. 

Consider four cases with the same initial values: y(0) = 1 and y'(0) = 0. 

1. y" + 3y' + y = Overdamped 

2. y" +2y' +y Critically damped 

3. y" + 0.2?/ + y = Underdamped 

4. y" + y = Undamped 
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Illustration of different types of damping. 




undamped 

underdamped + 

critically damped □ 

overdamped x 



5.6.2 SOLUTION TECHNIQUES OVERVIEW 



Differential equation 


Solution or solution technique 


Autonomous equation 


Change dependent variable to 

u(y) = y'(x) 


Bernoulli's equation 

y' + f(x)y = g(x)y n 


Change dependent variable to 

v(x) = (yix)) 1 -" 


Clairaut's equation 

f(xy' - y) = g(y') 


One solution is f{xC — y) = §{C) 


Constant coefficient equation 

a y {n) + W"- 1 ) + . . . 

+ an-iy' + a n y = 


There are solutions of the form 
y = x k e Xx . See Section 5.6.1.2. 


Dependent variable missing 

f(y( n \y( n - 1 \...,y",y l ,x)=0 


Change dependent variable to 

u(x) = y'(x) 


Euler's equation 

a x n y^ +a 1 x n - 1 y^- 1 ^ + ... 

+ a n -ixy' + a n y = 


Change independent variable to x = e* 


Exact equation 

M(x, y) dx + N(x, y) dy = 
dM ON 

Wlth "n - = "a - 

oy ox 


Integrate M(x,y) with respect to x 
holding y constant, call this m(x, y). 

Then m(x, y) + J - ^ J dy = C 


Homogeneous equation 

'='(5) 


In x = 1 — r-r~ 1" C unless 

J j{v) - v 
f(v) = v, in which case y = Cx. 


Linear first-order equation 

y' + f(x)y = g(x) 


y(x) = 

e -rf(t)dt j x e rf(t)dt g{z)dz + c 
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Differential equation 


Solution or solution technique 


Reducible to homogeneous 

{a\x + b\y + ci) dx 

+ (a 2 x + b 2 y + c 2 ) dy = 
with a\/a 2 ^ 61/62 


Change variables tow = a\x + b\y + c 
and v = a 2 x + b 2 y + c 


Reducible to separable 

(ciix + b\y + ci) dx 

+ (a 2 x + b 2 y + c 2 ) dy = 
with ai/a 2 = b\/b 2 


Change dependent variable to 

u(x) = a\x + b\y 


Separation of variables 

y' = f(x)g(y) 





5.6.3 INTEGRATING FACTORS 

An integrating factor is a multiplicative term that makes a differential equation have 
the form of an exact equation. If the equation M(x, y) dx + N(x, y) dy = is not 
in the form of an exact differential equation (i.e., M y ^ N x ) then it may be put into 
this form by multiplying by an integrating factor. 

1. If ± - |f ) = fix), a function of a; alone, then u (x) = exp(J x f(z) dz) 
is an integrating factor. 

2 - lf IT (w - lr) = 9(V), afunction of y alone, then U (y) = exp (J y g(z) dz) 
is an integrating factor. 

EXAMPLE The equation ^ dx + dy = has {M = y/x, N = 1} and f{x) = l/x. 

x 

Hence u(x) = exp(/ :c i dz) = exp (log a:) = x is an integrating factor. Multiplying 
the original equation by u(x) results in y dx + x dy = or d(xy) = 0. 



5.6.4 VARIATION OF PARAMETERS 

If the linear second-order equation L[y] = y" + P(x)y' + Q(x)y = R(x) has the 
independent homogeneous solutions u(x) and v(x) (i.e., L[u] = = L[v]), then the 
solution to the original equation is given by 

r \ , . f v(x)R(x) , , . f u(x)R(x) , 

y(x) = -u(x) / \/ \ J dx + v(x) / \ \ J dx, (5.6.6) 
J W(u,v) J W(u,v) 

where W(u, v) = uv' - u'v = \ ^ | is the Wronskian. 

EXAMPLE The homogeneous solutions to y" + y = esc x are u(x) = sin x and v(x) = 
cos a:. Here, W(u,v) = —1. Hence, y(x) = sin a: log (sin a:) — a: cos a:. 
If the linear third order equation L[y] = y'" + P 2 (x)y" + P(x)y' + Q(x)y = 
R(x) has the homogeneous solutions yi(x), y 2 (x), and 1/3(2;) (i.e., L[yi] = 0), then 
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the solution to the original equation is given by 



y(x) = yi 



w/ 



2/2 


V3 


o y' 2 


y' 3 


R y'i 


y'i 


W(y 1 ,y 2 


yz) 



dx + y-2 



+ J/3 



w/ 
w/ 



yi y 3 
y[ o y' 3 
y'i R y'i 



W(y 1 ,y 2 ,y 3 ) 
yi Vi 

y[ 2/2 o 

1/2 ^ 



W{yi,y 2 ,yz) 



dx 



dx 



where W (2/1,2/2, 2/3) 



3/1 3/2 3/3 

a! 2/2 »3 

»" »2 »3 



is the Wronskian. 



(5.6.7) 



5.6.5 GREEN'S FUNCTIONS 

Let L[2/] = /(a;) be a linear differential equation of order n, on (^o,^), for y(x) 
with the linear homogeneous boundary conditions {£?«[?/] = Yl*j=o ( a ijV^H x o) + 
bijyW (xi)) = 0}, for i = 1, 2, . . . , n. If there is a Green's function G{x\ z) that 
satis es 

L[G(x;z)}= S(x - z), 
Bi[G(x; z)} = 0, 

where <5 is Dirac's delta function, then the solution of the original system can be 
written as y(x) = J G(x; z)f(z) dz, integrated over an appropriate region. 

EXAMPLE To solve y" = f(x) with y(0) = and y(L) = 0, the appropriate Green's 
function is 

f OI 0<x<z, 

G(x;z) = { , L _ L) ~ " (5.6.9) 



Hence, the solution is 



•){x) 



[ G(x;z) f(z)dz= ( X Z<yX L) f(z)dz + [ X<yZ L) f(z)dz. (5.6.10) 
Jo Jo l Jx L 



5.6.6 TABLE OF GREEN'S FUNCTIONS 

For the following, the Green's function is G(x,£) when x < £ and G(£,x) when 
x>£. 



1. For the equation — — ■ = f(x) with 



(a) 2/(0) = 2/(1) = 0, G(x,0 

(b) 2/(0) = 0,2/'(l)=0, G(x,0 

(c) 2/(0) = -2/(1), 2/'(0) = -2/'(l), Gfofl 

(d) 2/(-l) = 2/(1) = 0, G(z,£) 



= -(i-£K 

= - and 

= -l(x-t-x£+l). 
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cPy 

2. For the equation — - —y = f(x) with y nite in (— oo, oo), 
ax 1 



G(x,0 



2 



cPy 

3. For the equation — - + k 2 y = fix) with 

dx z 

, , ,„> „ „, ^ sinfcrsinA;(l - £) 

(a) y(0) = y(l) = 0, G(x, £) = ^-jj- ^, 

(b) y (-l)= y (l), y '(-l)= y '(l),and G(x,a = C0Sfc 2 ( ^:/ fc + 1} - 

4. For the equation — — ■ — k 2 y = f(x) with 

ax 1 

<\ m\ m n /-</■ sinhfcEsinhA;(l - £) 

(a) j/(0) = j/(l) = 0, G(x,Q = — , 

(b) „(-l) = 2/(1), y'(-l)=y'(l), and = - ^^-|± 1} . 

5. For the equation 4~ (^"rO = /(^O* with 2/(0) mte an d 2/(1) = 0, 

ax \ ax J 

G(x,0=\nt 

d ( dy \ ttt* 2 

6. For the equation — ( a;— ) y = f(x), with 2/(0) nite and 2/(1) = 0, 

ax \ ax I x 



G ( x >0 = "sk [(f) -K) m ] - (m = l,2,...). 



d f d ^ 

7. For the equation — [ (1 — x 2 ) — I -y = /(x), withy(— 1) and 2/(1) 

ax V ax / 1 — x^ 



nite, = -gk (i±ffr!) ,(m = l,2,...) 



8. For the equation = fix), with 2/(0) = y'(0) = y(l) = y'(l) = 0, 

ax 4 

G(x,Z) = -^£(2xt + x-30- 



5.6.7 TRANSFORM TECHNIQUES 

Transforms can sometimes be used to solve linear differential equations. Laplace 
transforms (page 585) are appropriate for initial-value problems, while Fourier trans- 
forms (page 576) are appropriate for boundary-value problems. 



© 2003 by CRC Press LLC 



EXAMPLE Consider the linear second-order equation y" + y = p(x), with the initial 
conditions y(0) = and y (0) = 0. Multiplying this equation by e~ sx , and integrating 
with respect to x from to oo, results in 

POO POO POO 

I e~ sx y" (x) dx + I e~ sx y(x)dx= I e~ sx p(x)dx. 
Jo Jo Jo 

Integrating by parts, and recognizing that Y (s) = C[y(x)] = / °° e~ sx y(x) dx is the 
Laplace transform of y, this simpli es to 

POO 

(s 2 + l)Y(s) = / e- sx p(x) dx = C\p(x)]. 
Jo 

If p{x) = 1, then £[p(:r)] = s _1 . The table of Laplace transforms (entry 20 in the 
table on page 606) shows that the y(x) corresponding to Y(s) = l/[s(l + s 2 )] is 
y(x) = £- 1 [Y(s)] = l-cosx. 



5.6.8 NAMED ORDINARY DIFFERENTIAL EQUATIONS 

1. Airy equation: y" = xy 
Solution: y = c\ Ai(x) + c-2 Bi(x) 

2. Bernoulli equation: y 1 = a(x)y n + b(x)y 

3. Bessel equation: x 2 y" + xy 1 + (X 2 x 2 — n 2 )y = 
Solution: y = c\J n (\x) + C2Y n (\x) 

4. Bessel equation (transformed): x 2 y" + (2p + l)xy' + (X 2 x 2r + f3 2 )y = 



Solution: y = x p 



Cl J q/r (^-x r ^j +c 2 Y q/r (^-x r 



Vl^W 2 



x—a n -i 



5. Bocher equation: y" + \ + • 

i 1 [ A + A 1 x +—+A l x l 1 „ _ n 

+ 4 [( x - ai )™i(x-a 2 )™2-(x-a n - i y' l o-i \ V ~ U 

6. Duf n g's equation: y" + y + ey 3 = 

7. Emden-Fowler equation: (x p y')' ± x a y" = 

8. Hypergeometric equation: y" + + 1 -^f + v' 

_ I aa' , P£ , 77' ^ (a-b)(b-c)(c-a) _ q 

\(x — a)(b—c) (x — b)(c—a) (x — c)(a — b) J (x — a)(x — b)(x — c) 

{a b c ] 
a P 7 x > (Riemann's P function) 
a' p i J 

9. Legendre equation: (1 — x 2 )y" — 2xy' + n(n + l)y = 
Solution: y = c\P n {x) + c 2 Q„(a:) 

10. Mathieu equation: y" + (a — 2qcos2x)y = 

11. Painleve transcendent ( rst equation): y" = 6y 2 + x 
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12. Parabolic cylinder equation: y" + (ax 2 + bx + c)y = 

13. Riccati equation: y 1 = a(x)y 2 + b(x)y + c(x) 



5.6.9 LIAPUNOV'S DIRECT METHOD 

If, as x(t) evolves, a function V = V(x) can be found so that V(x(t)) > and 
^dt^ < for x ^ 0, then the system is asymptotically stable: V[x(£)] — > as 
t — > oo. 

EXAMPLE For the non-linear system of differential equations with a > 

• 2 2 

xi = —axi — xix 2 , X2 = —axi + x x X2, 

de ne V = x\ + x\ . Since V = -2a(x\ + x\) = -2aV we nd V = V(x(t)) = 
V e~ 2at . Hence xi(t) and x 2 (t) both decay to 0. 



5.6.10 LIE GROUPS 

The invertible transformation {x = <f>(x, y,a),y = ip(x, y, a)} forms a one-parameter 
group if (j>(x, y, b) = (j>(x, y, a + b) and ij)(x, y, b) = tp(x, y, a + b). For small a, 
these transformations become 

x = x + a£(x, y) + 0(a 2 ) and y = y + arj(x,y) + 0(a 2 ) (5.6.11) 

where the in nitesimal generator is X = i(x,y)-^ + f}(x,y)-^. If D = + 
y 1 4- + y" -Jr-T + ■ ■ ., then the derivatives of the new variables are 



y' = % = = = p ^ y'^ = y' + + °^ and 

ax Dip X + y'(j>y 

r = * = EL = P - + / P >:Z P >> = „» + * + o(.'), 

ax D<p <p x + y'<p y 



(5.6.12) 



where 



Ci = D(r,) - y'D(0 = r, x + ( % - " v'*£y, and 
C 2 = D(Ci) " I/"-D(0 = + (2%, - + fa™ " 2&„)i/' 2 ( 5 - 6 - 13 ) 



The prolongations of X are X^ = X + Ci^r and X< 2 ) = + (2^. For 
a given differential equation, the different in nitesimal generators will generate an 
r-dimensional Lie group (L r ). 

For the equation F(x,y,y' , y") = to be invariant under the action of the above 
group, X^F \p=o = 0. When F = y" — f(x,y,y'), this determining equation 
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becomes 



Vxx + (2>Vxy - ixx)v' + (Vyy ~ ^xy)v' ~ v' iyV 

+ (% ~ 2£r - ^y'iy)f ~ [vx + (Vy ~ £x)v' ~ y' 2 ] fy' 

-U*-Vfy = 0- (5-6.14) 

Given the two generators X x = £1 ^ + r\ x ^ and X 2 = 6^ + ^2^, the 
pseudoscalar product is X\ V X 2 = £1172 — ^2??i » and the commutator is [X\ , X 2 ] = 
X\X 2 — X 2 X\. By a suitable choice of basis, any two-dimensional Lie algebra can 
be reduced to one of four types: 



No. 


Commutator 


Pseudoscalar 


Typi ed by 


I 


[X u X 2 ]=0 


IiVl 2 ^0 




dx 9 dy } 


II 


[X u X 2 ]=0 


IiVl 2 =0 


{Xi 


= h x * = x p 


III 


[X 1 ,X 2 ]=X 1 


IiVl 2 ^0 


{Xi 




IV 


[X 1 ,X 2 ]=X 1 


Xi V x 2 = 


{Xi 


= 9^' X 2=y^} 



5.6.10.1 Integrating second-order ordinary differential equations 

An algorithm for integrating second-order ordinary differential equations is given 
by: 

1. Determine the admitted Lie algebra L r , where r is the dimension. 

2. If r < 2, then Lie groups are not useful for the given equation. If r > 2, 
determine a subalgebra L 2 C L r . 

3. From the commutator and pseudoscalar product, change the basis to obtain 
one of the four cases in the above table. 

4. Introduce canonical variables speci ed by the change of basis into the original 
differential equation. Integrate this new equation. 

5. Rewrite the solution in terms of the original variables. 



5.6.11 STOCHASTIC DIFFERENTIAL EQUATIONS 

A stochastic differential equation for the unknown X(t) has the form (here, a and b 
are given): 

dX(t) = a(X(t)) dt + b(X(t)) dB(t) (5.6.15) 

where B(t) is a Brownian motion. Brownian motion has a Gaussian probability 
distribution and independent increments. The probability density function f x(t) f° r 
X (t) satis es the forward Kolmogorov equation 

i t Ix(t){x) = \£s [b\x)f x(t) {x)} - £ [a(x)f x(t) (x)} . (5.6.16) 
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The conditional expectation of the function <f>(X(t)), u(t, x) = E[<f>(X(t)) | X(0) = x], 
satis es 

did' 2 d 

—u(t,x) = -b 2 (x)j—^u(t,x)+a(x)—u(t,x) with u(0, x) = <f){x). 

0v Zi 0X 0X 

(5.6.17) 



5.6.1 2 TYPES OF CRITICAL POINTS 

An ODE may have several types of critical points; these include improper node, 
de cient improper node, proper node, saddle, center, and focus. See Figure 5.1. 

FIGURE 5.1 

Types of critical points. Clockwise from upper left: center, improper node, deficient improper 
node, spiral, star, saddle. 




5.7 PARTIAL DIFFERENTIAL EQUATIONS 



5.7.1 CLASSIFICATIONS OF PDES 

Consider second-order partial differential equations, with two independent variables, 
of the form 

A(x, y)^+B(x,y)£g+ C(x, y)^=*(u,l%,§%,x,y). (5.7.1) 
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If 



B 2 
B 2 
B 2 



4AC > 
AAC = 
AAC < 



at some point (x, y), then Equation (5.7.1) is 



hyperbolic 
parabolic 
elliptic 



at 



that point. If an equation is of the same type at all points, then the equation is simply 
of that type. 



5.7.2 NAMED PARTIAL DIFFERENTIAL EQUATIONS 

1. Biharmonic equation: V 4 w = 

2. Burgers' equation: u t + uu x = vu xx 

3. Diffusion (or heat) equation: V(c(x, t)Vu) = u t 

4. Hamilton-Jacobi equation: V t + H(t, x, V Xl , . . . , V Xrl ) =0 

5. Helmholtz equation: V 2 u + k 2 u = 

6. Korteweg de Vries equation: u t + u xxx — 6uu x = 

7. Laplace's equation: V 2 u = 

8. Navier-Stokes equations: u t + (u • V) u = + f V 2 u 

9. Poisson equation: V 2 u = — 47rp(x) 

10. Schrodinger equation: — <^V 2 w + V(x)u = ihu t 

1 1 . Sine-Gordon equation: 

^ xx — ^yy ^- sin w — 

12. Tricomi equation: u yy =yu xx 

13. Wave equation: c 2 V 2 u = uu 

14. Telegraph equation: u xx = au tt + bu t + cu 



5.7.3 TRANSFORMING PARTIAL DIFFERENTIAL EQUATIONS 

To transform a partial differential equation, construct a new function which depends 
upon new variables, and then differentiate with respect to the old variables to see 
how the derivatives transform. 

EXAMPLE Consider transforming 

fxx + fyy + Xfy = 0, (5.7.2) 

from the {x, y} variables to the {u, v} variables, where {u = x, v = x/y}. Note that 
the inverse transformation is given by {x = u, y = u/v}. 

First, de ne g(u, v) as the function f(x, y) when written in the new variables, that 

is 

f{x,y) = g{u,v) = g [ x, - ) . (5.7.3) 



Now create the needed derivative terms, carefully applying the chain rule. For example, 
differentiating Equation (5.7.3) with respect to x results in 

f x (x,y) = 9 u§- x («) + 9v §- x (v) = fll A (*) + fl2 JL 

1 V 

= 91 +92 - = gi + -g2, 
y u 
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where a subscript of "1" ("2") indicates a derivative with respect to the rst (sec- 
ond) argument of the function g(u,v), that is, gi(u, v) = g u {u,v). Use of this 
"slot notation" tends to minimize errors. In like manner 



j\ (..:, y) = g u |- («) + g v ± (v) = fll |- (a) + 92 1- 

a; 



792 = 92- 

u 



The second-order derivatives can be calculated similarly: 

f xx (x,y) = (f x (x,y)) = A U + I fl2 







= 9ii + 


2v 

— 912 + 

u 


v 2 

^7922, 

u 2 






y) 






u 2 

= — 5-92 - 

V 2 


u 3 
■ "1-912 


fw( x : 


y) 




-f 292 ) 


2v 3 
= —5-92 + 

u 2 


« 4 

—5-922- 



^-922, 



Finally, Equation (5.7.2) in the new variables has the form, 

= fxx fyy ~l~ xf< 



( 



yy > -LJy 

2v v 2 \ / 2w 

911 H 912 + ^-922 + —5-92 + ^-922 + (u) [ 92 

u u 2 J \ u 2 u 2 j \ u 

2/ ». „.2\ o„. „.2/l 1 „,2\ 



« 2 (2«-m 2 ) 2w « 2 (1 +v 2 ) 

Qv ~\~ Quu ~\~ Quv ~\~ .-) Qw • 

u z u u z 



5.7.4 WELL-POSEDNESS OF PDES 

Partial differential equations involving u(x) usually have the following types of 
boundary conditions: 

1. Dirichlet conditions: u = on the boundary 

2. Neumann conditions: |^ = on the boundary 

3. Cauchy conditions: u and |^ speci ed on the boundary 

A well-posed differential equation meets these conditions: 

1 . The solution exists. 

2. The solution is unique. 

3. The solution is stable (i.e., the solution depends continuously on the boundary 
conditions and initial conditions). 
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Type of equation 


Type of boundary 


Elliptic 


Hyperbolic 


Parabolic 


conditions 








Dirichlet 








Open surface 


Undetermined 


Undetermined 


Unique, stable 
solution in one 
direction 


Closed surface 


Unique, stable 
solution 


Undetermined 


Undetermined 


Neumann 








Open surface 


Undetermined 


Undetermined 


Unique, stable 
solution in one 
direction 


Closed surface 


Overdetermined 


Overdetermined 


Overdetermined 


Cauchy 








Open surface 


Not physical results 


Unique, stable 
solution 


Overdetermined 


Closed surface 


Overdetermined 


Overdetermined 


Overdetermined 



5.7.5 GREEN'S FUNCTIONS 

In the following, r = (x,y,z), r = (x ,y ,z ), R 2 = (x - x ) 2 + (y - y ) 2 + 
(z - z f, P 2 = (x - x ) 2 + (y - y ) 2 - 

1. For the potential equation V 2 G + k 2 G = — 47r<5(r — r ), with the radiation 
condition (outgoing waves only), the solution is 



G 



2n± e %k\x-x \ in one dimension, 
iwH^ (kP) in two dimensions, and 
^ 2-^- in three dimensions, 



(5.7.4) 



where ff^G) 

is a Hankel function (see page 559). 
2. For the n-dimensional diffusion equation 

BC 

V 2 G -a 2 — = -47r<5(r - r )6(t - t ), 
at 



(5.7.5) 



with the initial condition G = for t < to, and the boundary condition G = 
at r = oo, the solution is 



G = —( a 

a 2 \2^7r(t-t ) 

3. For the wave equation 



exp 



a 2 |r-r | 2 
" 4(t-t ) 



(5.7.6) 



V ' G " j> = ~ 4 ^( r ~ r o)^(* " *o), 



(5.7.7) 
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with the initial conditions G = Gt = for t < to, and the boundary condition 
G = at r = oo, the solution is 



G 



2ckH ^(t — to) — li-MLj in one space dimension, 

j 2 TT P / J- J- \ P ~| in til Jt~\ o f"\ r\ ^ i w"\ i~w i /\n f 



^(i-io) 2 -/ 32 

l¥ [f -(*-*o)] 



# [(i — to) — "jr] m two space dimensions, and 



in three space dimensions. 



where H(-) is the Heaviside function. 



(5.7.8) 



5.7.6 QUASI-LINEAR EQUATIONS 

Consider the rst-ord er quasi-linear differential equation for u(x) = u(x i, . . . ,xn), 

a 1 (x,u)u Xl + a 2 (x,u)u X2 H h a N (x, u)u XN = b(x,u). (5.7.9) 

De ning ^j- = ak(x,u), for k = 1, 2, N, the original equation becomes ^ = 
b(x,u). To solve the original system, the ordinary differential equations for u(s,t) 
and the {xu (s, t)} must be solved. Their initial conditions can often be parameterized 
as (witht = (ii,.. • ,ijv-i)) 



u(s 


= 0,t) 


= «(t), 


x 1 (s 


= 0,t) 


= /ii(t), 


x 2 (s 


= 0,t) 


= /i 2 (t), 



(5.7.10) 

a;jv(a = 0,t) =h N (t), 
from which the solution follows. This results in an implicit solution. 

EXAMPLE For the equation u x + x 2 u v = —yu with u = f(y) when x = 0, the 
corresponding equations are 

dx dy 2 du 

The original initial data can be written parametrically as a;(s = 0,t) = 0, y(s = 
0,h) = ti, and u(s = 0,h) = f{h). Solving for x results in x(s,h) = s. The 

3 

equation for y can then be integrated to yield y(s, t\) = ^- + t\. Finally, the equa- 
tion for u is integrated to obtain u(s, t\ ) = f(t i ) exp ^— — sti ^ . These solutions 
constitute an implicit solution of the original system. 

In this case, it is possible to eliminate the s and ti variables analytically to obtain 

x 3 \ fx* 



the explicit solution: u(x, y) = f[y —J exp I — xy 



5.7.7 SEPARATION OF VARIABLES 

A solution of a linear PDE is attempted in the form u(x) = u(x\ , x 2 , ■ ■ ■ ,x n ) 
Xi(xi)X 2 (x 2 ) ■ ■ ■ X n (x n ). Logical reasoning may determine the {X{\. 
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1 . For example, the diffusion or heat equation in a circle is 



du 



V 2 u 



1 d ( du 



r dr\ dr 



+ 



1 d 2 u 
r 2 88 2 



(5.7.11) 



for the unknown u(t, r, 8), where t is time and (r, 8) are polar coordinates. If 
u(t, r, 8) = T(t)R(r)@(8), then 



- + 



1 d fdR\ 
rR dr \ 

Logical reasoning leads to 

i d 2 e 



1 d 2 @ 1 dT 



dr J r 2 @ d8 2 T dt 



(5.7.12) 



1 dT 
T~dt 



-A, 



d ( dR 



6 d8 2 



dr V dr 



+ (-p + r 2 X)R = 0, 



where A and p are unknown constants. Solving these ordinary differential 
equations yields the general solution, 

L (t,r,8)= dX dpe- xt \B(X,p)sm(y^8) + C(X,p)cos(^p8)\ 

J — oo J — oo L J 

x [D(X, pp^iVXr) + E(X, p)Y V p(VXr)] . 



(5.7.13) 



Boundary conditions are required to determine the {B, C, D, E}. 



2. A necessary and suf cient condition for a system with Hamiltonian H = 
\{p 2 +p 2 y ) + V(x, y), to be separable in elliptic, polar, parabolic, or Cartesian 
coordinates, is that the expression, 

(V yy — V xx )(—2axy — b'y — bx + d)+ 2V xy (ay 2 — ax 2 + by — b'x + c — c') 

+ V x {<oay + 36) + V y (-6ax - 36'), (5.7.14) 

vanishes for some constants (a, 6, 6', c, c', d) ^ (0, 0, 0, c, c, 0). 

3 . Consider the orthogonal coordinate system {u 1 , u 2 , u 3 } , with the metric { g , , } , 
and g = gn 922 933- The Stackel matrix is de ned as 



^niu 1 ) Q^iu 1 ) ^(w 1 )' 

$2l(u 2 ) $22(« 2 ) $23(« 2 ) 
$3l(« 3 ) $32(« 3 ) $33(« 3 ) 



(5.7.15) 



where the {$y } are tabulated in different cases. The determinant of S can be 
written as s = $nMn + $21-^21 + $3iM 33 , where 



$22 $23 
$32 $33 



M 2 i 



$12 $13 
$32 $33 



M 31 



$12 $13 
$22 $23 

(5.7.16) 
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If the separability conditions, gu = s/M^ and y/g/s = f\{u 1 )f2{u 2 )fz{u i ), 
are met then the Helmholtz equation V 2 W + X 2 W = separates with W = 
X 1 (u 1 )X 2 (u 2 )X 3 (u 3 ). Here the {XJ are de ned by 



LA 

Si du 



{ dX \ 3 



with <x\ = A 2 , and ai and a 3 arbitrary. 

(a) Necessary and suf cient conditions for the separation of the Laplace 
equation (SJ 2 W = 0) are 

^l = ^i and ^ = / 1 (« 1 )/ 2 (« 2 )/ 3 (« 3 )M il . (5.7.18) 

(b) Necessary and suf cient conditions for the separation of the scalar Heml- 
holtz equation are 

9u = ^- i and ^ = h{u')h{u 2 )h{u z ). (5.7.19) 



EXAMPLE In parabolic coordinates {p, v,ip} the metric coef cients are gu = gii 
ji 2 + v 2 and p 33 = ji 2 v 2 . Hence, ^fg = /iuQi 2 + v 2 ). For the Stackel matrix 



V 

v 2 




-i/V' 
-i/, 2 
i 



(5.7.20) 



(for which s = fi 2 + v 2 , M n = M 2i = 1, and M 31 = fi~ 2 + v~ 2 ), the separability 
condition holds with /i = fi, / 2 = ^, and / 3 = 1. Hence, the Helmholtz equation 
separates in parabolic coordinates. The separated equations are 



OLi -]=0, 



\tv ( v i£) + X2 H 2 + a2 - S) = °' and (5 - 7 - 21) 



+ a 3 X 3 



where W = X x {fj)X 2 {y)X 3 {i)). 



5.7.8 SOLUTIONS OF LAPLACE'S EQUATION 

1. If V 2 u = in a circle of radius R and u(R,6) = /(#), for < 9 < 2tt, then 
u(r,9) is 
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2. If V 2 w = in a sphere of radius one and u(l, 9, <j>) = f(9, <j>), then 

u(r,6,<i>) = -}- p f(Q,<f>) - 1 ~ r \ S inQdQd>f>, 
47r J J (1 - 2r cos 7 + r 2 ) J / 2 

where cos 7 = cos # cos 6 + sin # sin 6 cos(<^ — $). 

3. If V 2 w = in the half plane y > 0, and u(x, 0) = /(a;), then 

f(t)y 



1 r 00 

« x > y) = «L { x -ty + y>- 

4. If V 2 w = in the half space z > 0, and u(x, y, 0) = /(a;, y), then 

u(x,y,z) = — / / —rrdCari. 

V 1 2irJ_ 00 J_ 00 [( x -() 2 + (y- i,) 2 + rf /2 



5.7.9 SOLUTIONS TO THE WAVE EQUATION 

1. Consider the wave equation |^ = V 2 u = + • • • + -§^i, with x = 
(x\ , . . . , x n ) and the initial data u(0, x) = /(x) and u t (0, x) = <?(x). When n 
is odd (and n > 3), the solution is 

1 f S / S \ ( n_3 )/ 2 

"^ = 1.3-(n-2) {ftU) '" 

'(n-3)/ 2 ^ 
~t~ ( TTTT I * " 



tdt 



t n - 2 uj[g;x,t}}, 



where w[/i;x,i] is the average of h(x) over the surface of an n-dimensional 
sphere of radius t centered at x; that is, u)[h; x, t] = - — — j-^j / h(() dfl, where 
\( — x| 2 = t 2 ,a n -i(t) is the surface area of the n-dimensional sphere of radius 
t, and dfl is an element of area. 



When n is even, the solution is given by 

u(t,x) 



1 f d ( d V"" 2 )/ 2 /-* [£ pn^dp 



2-4---(n-2)\dt\tdtJ Jo u ' ,H1 yW^p 



+ 



(5.7.23) 



where u[h; x, i] is de ned as above. Since this expression is integrated over 
p, the values of / and g must be known everywhere in the interior of the 
n-dimensional sphere. 
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Using u n for the solution in n dimensions, the above simplify to 



«i(M) = \[f(x-t)+f(x + t)} + \ ' 



x+t 



9(0 d(, 



(5.7.24) 



1 d fff(x 1 +( 1 ,x 2 +( 2 ) 



If 



2ndtJJ V* 2 -Ci 2 -Cf 

i f[g(xi +&,X2 + C2) 



v^-c 2 -^ 



cZCi ^2 , and 



u 3 (x,t) = —(tuj[f;x,t}^ +tuj[g;x,t], 
where R(t) is the region {((1,(2)! Ci 2 + Cl < t 2 } and 

co[h;x, t] = — J J h(xi +tsin9cos<fi,X2 +tsin9sm<fi, (5727) 

X3 + t cos 9) x sin 9 d9 d<j>. 

2. The solution of the one-dimensional wave equation 

„2„ 



(5.7.25) 
(5.7.26) 



u(0,i) = 0, 
v(x,0)=f(x), 
v t (x,0) = g(x), 



for < t < oc, 
for < x < 00, 
for < x < oc, 



(5.7.28) 



is 



v(x, t) 



\ [f(x + ct) + f{x - ct)] + l c f*+* 9(0 d(, for x > ct, 
\ [f(x + ct) - fict -x)] + ± C-l 9(0 d(, for x < ct. 



3. The solution of the inhomogeneous wave equation 

d 2 u d 2 u d 2 u d 2 u _ 

dt 2 ~ dx 2 ~ dy 2 ~ dz 2 ~ F V> X >V' Z >' 

with the initial conditions u(0, x, y, z) = and u t (0, x, y, z) = 0, is 



1 

u{t,x,y,z) = — 



' F(t-P,(,ri,0 



d( drj d£, 



(5.7.29) 



(5.7.30) 



(5.7.31) 



with p = ^/{x-ty + iy-vY + iz-O 2 - 
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5.7.10 PARTICULAR SOLUTIONS TO SOME PDES 

In these tables, we assume that P(x) is a polynomial of degree n. 





If R(x) is 


A particular solution to z x ~\~ TiiZy — R(x, y) is 


(1) 


e ax+by 


e ax+by /(a + mb). 


(2) 


f(ax + by) 


J f(y) du/(a + mb), u = ax + by. 


(3) 


f(y - mx) 


xf(y -mx). 


(4) 


4>(x,y)f(y - mx) 


evaluate f(y — mx) J (f>(x, a + mx) dx; then 






substitute a = y — mx. 





If R(x) is 


A particular solution to z x + mz y — kz = R(x, y) is 


(5) 


e ax+by 


e ax+by /(a + mb-k). 


(6) 


sin(aa; + by) 


(a+bm) cos(ax+by)+k sin(ax+by) 
(a+bmY 2 +k 2 


(7) 


e ax+l3y s i n ( aa; _|_ by^ 


Replace k by k — a — m(3 in formula (6) and multiply 

by e ax+f3y_ 


(8) 


e xk f(ax + by) 


e kx J f(y) du/(a + mb), u = ax + by. 


(9) 


f(y - mx) 


-f(y ~mx)/k. 


(10) 


p (x)f(y - mx) 


-if(y-mx)[ P (x) + q?l + ^ + ... + ^]. 


(11) 


e kx f(y — mx) 


xe kx f(y — mx). 



5.8 EIGENVALUES 

The eigenvalues {A,} of the differential operator L are the solutions of L[ui] = 
AjMj. Given a geometric shape, the eigenvalues of the Dirichlet problem are called 
eigenfrequencies (that is, V 2 u = Xu with u = on the boundary). 

(a) You cannot hear the shape of a drum. The following gur es have the same 
eigenfrequencies . 
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(b) You cannot hear the shape of a two-piece band. The following pairs of gur es 
have the same eigenfrequencies. 




5.9 INTEGRAL EQUATIONS 



5.9.1 DEFINITIONS 

r b(x 



h(x)u(x) = f{x) + X k(x,t)G[u(t);t]dt. (5.9.1) 

J a 



k(x,t) kernel 

u(x) function to be determined 

h(x), f(x), b(x), G[z,t] given functions 

A eigenvalue 



5.9.1.1 Classi cation of integral equations 

1. Linear G[u{x)\ x] = u{x) 

2. Volterra b{x) = x 

3. Fredholm b (x) = b 

4. First kind h(x) = 

5. Second kind h(x) = 1 

6. Third kind h(x) ^ constant 

7. Homogeneous f(x) = 

8. Singular a = — oo, b = oo 



5.9.1.2 Classi cation of kernels 

1. Symmetric k(x,t) = k(t,x) 

2. Hermitian k(x,t) = k(t,x) 

3. Separable/degenerate k(x,t) = Yl™=i a i( x )bi(t), n < oo 

4. Difference k(x,t) = k(x - t) 

5. Cauchy k(x,t) = 

6. Singular k(x,t) — > oo as t — > x 

1. Hilbert-Schmidt Si Sa \ k (x,t)\ 2 dxdt < oo 
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5.9.2 CONNECTION TO DIFFERENTIAL EQUATIONS 

The initial-value problem 

u"(x) + A(x)u'(x) + B(x)u(x) = g(x), x > a, 
u(a) = ci, u'(a) = c 2 , 

is equivalent to the Volterra integral equation, 

u(x)=f(x)+ / k(x,t)u(t) dt, x > a, 

J a 

f(x)= I (x-t)g(t)dt + (x-a)[A(a)c 1 +c 2 ]+c 1 , 

J a 

k(x,t) = (t- x)[B(t) - A'(t)\ - A(t). 

The boundary- value problem 

u"(x) + A(x)u'(x) + B(x)u(x) = g(x), a < x <b, 
u(a) = ci, u(b) = c 2 , 

is equivalent to the Fredholm integral equation 

rb 



u(x) 



fix) = ci + 



k(x, t) 



x — a 



r 

■ f(x) + / k(x, t)u(t) dt, a < x <b, 

J a 

[ {x-t)g(t)i 

J a 

■^ {A {t)-{a-t)[A'{t)-B{t)}}, x>t, 
*=± {A (t)-(b-t)[A'(t)-B(t)]}, x<t. 



c 2 - Ci 



■ f\b-t)g(t) 

J a 



(5.9.2) 



(5.9.3) 



(5.9.4) 



dt 



(5.9.5) 



5.9.3 FREDHOLM ALTERNATIVE 

Foru(a;) = f(x)+X k{x, t)u{t) dt with A ^ 0, considerthe solutions touH{x) = 
A J 6 k(x,t)uH(t) dt. 

1. If the only solution is ur{x) = 0, then there is a unique solution u(x). 

2. If ur{x) ^ 0, then there is no solution unless J"* u* H (t)f(t) dt = for all 

u* H {x) such that u* H (x) = A J"* k{t,x)u* H {t) dt. In this case, there are in- 
nitely many solutions. 
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5.9.4 SPECIAL EQUATIONS WITH SOLUTIONS 

, _ . f x u(t) dt , . . 

1. Generalized Abel equation: / . — — = fix) 

J [h(x)-h(t)}" M 1 



Solution is 

where < x < 1, < a < 1, < h(x) < 1, h'(x) > 0, and /i'(x) is 
continuous. 

- 1 «(t) 



2. Cauchy equation: fiu(x) = f(x) + 4 

Jo 



t — x 



dt 



Solution is 



a* sin (jn) d f i ds f s t->f(t) 
v ^ ] (i-^^sin 2 ^) d r' ds f i (i-t)-VW ^ u>0 

where < x < 1, /i is real, /i ^ 0, |//| = 7r cot(7T7), < 7 < 1/2, and the 
integral is a Cauchy principal value integral. 

r 

3. Volterra equation with difference kernel: u(x) = f(x)+ A / k(x — t)u(t) dt 

Jo 

Solution is 



u(x) = Cr l 



F(s) 



1 - XK(s) 

for x > 0, £ [/(x)] = F(s) and £ [fc(x)] = K{s). 



(5.9.8) 



/oo 
k(x-t)u(t) dt 
-00 

Solution is 

1 f°° Fia) 
u(x) = ^ e~ tax - r^da (5.9.9) 

where -00 < x < 00, F(a) = -F[/(x)], and X(a) = T[k(x)}. 
5. Fredholm equation with separable kernel: 

^ a k (x)b k (t)u(t) dt 

- *=i 

Solution is 

n 

u(x) = /(x) + A c k a k (x), (5.9.10) 



6 



b m (t)f(t) dt + A ^ / b m (t)a k (t) dt where a < x < 6, 



n < 00, and to = 1, 2, . . . , n. 
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6. Fredholm equation with symmetric kernel : u (x) = f(x) + A / k(x,t)u(t)dt 

J a 

Solve u n (x) = A„ J a k(x, t)u n (t) dt for {u n , A„}„ = i j2> .... Then 

u n( x ) f b f(t)u„(t)dt 

(a) For A ^ A n , solution is u(x) = j(x) + A > — g . 

n=1 (A„ -A)/ dt 

(b) For A = A„ and J f(t)u m (t) dt = for all to, solutions are 

, i s , V' u n (x) f(t)u n (t)dt 

u(x) = f(x) + cu m (x) + X m t , 

n=1 (A„ - A m )J a u 2 n (t)dt 

for to = 1, 2, . . . 
where a < x <b, and &(a;, i) = &(t, x) (see Section 5.9.3). 

7. Volterra equation of second kind: u(x) = f(x) + A / fc(x, i)w(i) 

J a 

Solution is 

u(x)=f(x)+\f f^X n k n+1 (x,t)f(t)dt, (5.9.11) 

Ja n=0 

where k\ (x, t) = k(x,t), k n+ \(x,t) = f k(x,s)k n (s,t) ds, when k(x,t) 
and f(x) are continuous, A ^ 0, and x > a. 

8. Fredholm equation of second kind: resolvent kernel 

u{x) = f{x) + A f k(x,t)u(t)dt (5.9.12) 

J a 

Solution is 

= f(x) + A ^ gjglM /(t) dt, (5.9.13) 

where 

(-A)"c„ 



2?(A) = £ 



n! 

n=0 



! 

6 



c = l, c„= /* A n _ 1 (t,t)dt, n = 1,2,..., (5.9.14) 



7Xx,t;A) = fc(M) + £^^- J4 »( a; > ^ )> 
' ^ — ' n! 

Ao(a;, t) = k(x, t) 

,6 

A n (x,t) = c n k(x,t) — n / k(x, s) A„_i (s, t) ds 



where k(x, t) and f(x) are continuous, A ^ 0, a < x < b, and D(A) ^ 0. 
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9. Fredholm equation of second kind: Neumann series 

r b 



Solution is 



u(x) = f(x)+\[ k(x,t)u(t)dt (5.9.15) 

J a 

oo 

u{x) = f{x) + Y j y i 4>n{x), (5.9.16) 



n=l 



where 



bn(x) = / k„(x,s)f(s)ds 

J a 

Cl (x, s) = k(x, s), 

,6 

and fc„(x,s) = / k(x,t)k n -i(t,s) dt, n = 2,3 



h(x,s) = k(x,s), (5.9.17) 

-6 



/ . . \-l/2 

where |A| < f / a / a fc 2 (a;, i) cfa; dt) , A ^ 0, and a < x < b. 



5.10 TENSOR ANALYSIS 



5.10.1 DEFINITIONS 

1. An n-dimensional coordinate manifold of class C k , k > 1, is a point set M 
together with the totality of allowable coordinate systems on M. An allowable 
coordinate system ((f), U) on M is a one-to-one mapping <f> : U — > M, where U 
is an open subset ofE™. Then-tuple (x 1 , ... ,x n ) € U give the coordinates of 
the corresponding point ^(x 1 , . . . , x") € M. If (<^>, ?7) is a second coordinate 
system on M, then the one-to-one correspondence o <j> : U — > U, called 
a coordinate transformation on M, is assumed to be of class C k . It may be 
written as 

x l = fix 1 ,...^ 11 ), i = l,...,n, (5.10.1) 

where the / are de ned by o ^(x 1 , . . . , x n ) = (f 1 (x 1 , . . . , x n ), . . . , 
f n {x 1 , . . . , x n )). The coordinate transformation o <j> has inverse o <j>, 
expressible in terms of the coordinates as 

x i = f{x i"), i = l,...,n. (5.10.2) 

2. In the Einstein summation convention a repeated upper and lower index signi- 
es summation over the range k = 1, . . . , n. 
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3. The Jacobian matrix of the transformation, satis es 4ns- fer = 8] and 

' ax 3 ' ox* ox 3 J 

ffrffj = Sj, where Sj = < ^ denotes the Kronecker delta. Note 
also that det ^ 0. 

4. A function F : M — > K is called a scalar invariant on M. The coordinate rep- 
resentation ofF in any coordinate system ((f), U) is de ned by / := Fo<j>. The 
coordinate representations / of F with respect to a second coordinate system 
(I U) is related to / by fix 1 ,...,x n ) = f(f (x 1 , . . . , x »),..., /"Or 1 , • • ., 

5. A parameterized curve on M is a mapping 7 : 7 — > M, where 7 C IK is some 
interval. The coordinate representation ofj in any coordinate system [/) 
is a mapping g : I — » E™ de ne d by g = <p _1 o 7. The mapping g de nes a 
parameterized curve in IK™. The component functions of g denoted by g l (for 
i = 1, . . . ,n) are de ned by <?(i) = (<jf 1 (i), • • • , g n {t)). The curve 7 is if, 
and only if, the functions g % are for every coordinate system on M. The 
coordinate representation g of 7 with respect to a second coordinate system 
(&u) is related to g by g* (t) = /V(*)> ■ ■ ■ ,J n (<)). 

6. A mixed tensor T of contravariant valence r, covariant valence s, and weight 
w atp £ M, called a tensor of type (r, s, w), is an object which, with respect 
to each coordinate system on M, is represented by n r+s real numbers whose 
values in any two coordinate systems, <f> and <f>, are related by 

■i—kr ® x%r ® xtl ® xl " 

h-t. Q x k^ ' ' ' q x k dx~h ' ' ' ~d&I- 

v '- * ' 

r factors s factors 

(5.10.3) 

The superscripts are called contravariant indices and the subscripts covariant 
indices. If w ^ 0, then T is said to be a relative tensor. If w = 0, then 
T is said to be an absolute tensor or a tensor of type (r, s). In the sequel 
only absolute tensors, which will be called tensors, will be considered unless 
otherwise indicated. A tensor field T of type (r, s) is an assignment of a tensor 
of type (r, s) to each point of M. A tensor eld T is C k if its component 
functions are C k for every coordinate system on M. 



d6t (flfJ 



5.10.2 ALGEBRAIC TENSOR OPERATIONS 

1 . Addition: The components of the sum of the tensors T\ and T 2 of type (r, s) 
are given by 

T h-ir =T h-i r + T 9 h - ir . (5.10.4) 

2. Multiplication: The components of the tensor or oMfer product of a tensor Ti 
of type (r, s) and a tensor T 2 of type (t, u) are given by 

rp h---i r ki---k t rp i\ rpk\---k t (C irv c\ 
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3. Contraction: The components of the contraction of the t contravariant index 
with the u th covariant index of a tensor T of type (r, s), with rs ^ 0, are given 

y jl-"ju-l*ju + l-"j»' 

4. Permutation of indices: Let T be any tensor of type (0, r) and 5 r the group 
of permutations of the set {1, •• • , r}. The components of the tensor obtained 
by permuting the indices of T with any a € S r , are given by (aT) il ... ir = 
Ti a(1) ...i a(r) . The symmetric part of T, denoted by <S(T), is the tensor whose 
components are given by 

S(T) h ... ir = T (il ... ir) = -^ ^2 T Mi)-M„) • (5.10.6) 

aeS r 

The tensor T is said to be symmetric if, and only if, T^...^ = T^ 1 ...i r )- The 
skew symmetric part of T, denoted by A(T), is the tensor whose components 
are given by 

A{T) h ... ir = T {il .. M = 4 E s g n ( ff ) T v (1) -v M . ( 5 - 10 - 7 ) 

where sgn(<r) = ±1 according to whether a is an even or odd permutation. 
The tensor T is said to be skew symmetric if, and only if, T^...^ = 7]^...^]. 



5.10.3 DIFFERENTIATION OF TENSORS 

1. In tensor analysis a comma is used to denote partial differentiation and a 
semicolon to denote covariant differentiation. For example, „ denotes 
0A ij ...i/0.r". 

2. A linear connection V at p € M is an object which, with respect to each 
coordinate system on M, is represented by n 3 real numbers T l - k , called the 
connection coefficients, whose values in any two coordinate systems <j> and <j> 
are related by 

~i i dx l dx m dx n d 2 x e dx l 

The quantities T l - k are not the components of a tensor of type (1, 2). A linear 
connection V on M is an assignment of a linear connection to each point of 
M. A connection V is C k if its connection coef cien ts T l ^ k are C k in every 
coordinate system on M. 

3. The components of the covariant derivative of a tensor eld T of type (r, s), 
with respect to a connection V, are given by 

/•"-';„.,, '4 /•"-;,..,, +r* fl i*"l,, + ••• (5.10.9) 

_l_ -pi r rpil---ir-l£ -pi rpi\---i r -pi rpi\---i r 

hi Ik 1 h-i, 1 hk 1 lh-j,"' 1 jsk 1 ji-j.-il' 
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where 



d k T^\., s = /•""-...,., = i)T ] ) ) (5-10.10) 

This formula has this structure: 

(a) Apart from the partial derivative term, there is a negative af ne term for 
each covariant index and a positive af ne term for each contravariant 
index. 

(b) The second subscript in the T-symbols is always the differentiated index 
(k in this case). 

4. Let Y l {t) be a contravariant vector eld and Zi(t) a covariant vector eld 
de ne d along a parameterized curve 7. The absolute covariant derivatives of 
Y l and Zi are de ned as follows: 

5 li = d li + p . k Y i — 

St dt Jh dt (5.10.11) 
S_Z,_ _dZ,_ _ j dx k 

St ~ dt ik j dt 

where x % denotes the components of 7 in the coordinate system <f>. This deriva- 
tive may also be de ned for tensor elds of type (r, s) de ned along 7. The 
derivative has the same structure as Equation (5.10.9). 

5. A vector eld Y l {t) is said to be parallel along a parameterized curve 7 if 

= 
st u - 

6. A parameterized curve 7 in M is said to be an ajfinely parameterized geodesic 
if the component functions of 7 satisfy 

S (dx l \ (fix 1 : dxi dx k 

Jt\dT) = ~dl r+ jk ~dT~dT = 

which is equivalent to the statement that the tangent vector ^ to 7 is parallel 
along 7. 

7. The components of the torsion tensor S of V on M are de ne d by 

Vjk I".,a- IV (5-10.12) 

8. The components of the curvature tensor R of V on M are de ned by 

Rl ju = dk^ji - d e T % jk + r m ^r* mi . - T m jk T % mi . (5.10.13) 
In some references R is de ned with the opposite sign. 

9. The Ricci tensor of V is de ned by Rjt = R l j ke - 
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5.10.4 METRIC TENSOR 



1. A covariant metric tensor field on M is a tensor eld g t j which satis es 
9ij = 9ji ar, d 9 = det(gij) ^ on M. The contravariant metric <? 8J sat- 
is es g lk gkj = Sj- The line element is expressible in terms of the metric 
tensor as ds 2 = gijdx % dxK 

2. Signature of the metric: For eachp £ M, a coordinate system exists such that 

9ij(p) = diag (1, ■ " " j 1) ~~ 1) ' ' ' j — 1) ■ The signature of <?,j is de ned to be 
v v ' v ' 

r n — r 

s = 2r — n. It is independent of the coordinate system in which g^ (p) has the 
above diagonal form and is the same at every p € M. A metric is said to be 
positive definite if s = n. 

A manifold admitting a positive de nite metric is called a Riemannian man- 
ifold. A metric is said to be indefinite if s ^ ±n. A manifold, admitting an 
inde n ite metric is called a pseudo-Riemannian manifold. If s = ±(n — 2) 
the metric is said to be Lorentzian and the corresponding manifold is called a 
Lorentzian manifold. 

3. The inner product of a pair of vectors X 1 and Y- 7 is given by gijX % YK If 
X 1 = Y\ then g^X* de nes the "square" of the length of X\ If gij is 
positive de nite, then gijX*X j > for all X\ and gijX*X j = if, and 
only if, X 1 = 0. In the positive de nite case, the angle 8 between two tangent 
vectors X 1 and is de ned by cos<9 = gijX^i /(g M X k X l g mn Y m Y n )i . 
If g is inde nite, g^X l X^ may have a positive, negative, or zero value. A 
non-zero vector X\ satisfying gijX l X^ = 0, is called a null vector. If g^ is 
inde n ite, it is not possible in general to de ne the angle between two tangent 
vectors. 

4. Operation of lowering indices: The components of the tensor resulting from 
lowering the t' h contravariant index of a tensor T of type (r, s), with r > 1, 
are given by 

h h-js=9hkT .„..„.• (5.10.14) 

5. Operation of raising indices: The components of the tensor resulting from 
raising the t th covariant index of a tensor T of type (r, s), with s > 1, are 
given by 

J ji-jt-i -jt+i-js - 9 1 ji-h-ikjt+i-j.- yj.iv.iD) 

6. The arc length of a parameterized curve 71/4 M, where / = [a, b], and ^ 
is any coordinate system, is de ne d by 

L= ( Jegtjix 1 ^), - ■ ■ ,x n {t))x i x^ dt, (5.10.16) 

J a 

where e = sgn(gijX % x j ) = ±1 and x l = 
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5.10.5 RESULTS 



The following results hold on any manifold M admitting any connection V: 

1 . The covariant derivative operator V & is linear with respect to tensor addition, 
satis es the product rule with respect to tensor multiplication, and commutes 
with contractions of tensors. 

2. If T is any tensor of type (0, r), then 

^[k T h-i r \ = T [h-i r ,k\ ~ 2 {s\hk T Wi-iA H h S \i rh T ii-ir-i]t) ' 

(5.10.17) 

where | | indicates that the enclosed indices are excluded from the symmetriza- 
tion. Thus T^...^ ^ denes a tensor of type (0,r + 1), and V^T^...,^ = 
T[i 1 ..-i rt k] in the torsion free case. If Tj = Vj/ = /j ;, where / is any scalar in- 
variant, then V[jVj]/ = \f tk S k i j. In the torsion free case, V«Vj/ = VjVj/. 

3. If X % is any contravariant vector eld on M, then the identity 2V yV k ]X l + 
V tX l S l j k = X l R l l - k , called the Ricci identity, reduces to 2VyV k ]X t = 
R l l j k X e , in the torsion free case. If Y, is any covariant vector eld, the Ricci 
identity has the form 2V [i V j] Y k - V e Y k S e i:j = -Y e R e kij . The Ricci identity 
may be extended to tensor elds of type (r, s). For the tensor eld T'j k , it has 
the form 

OV7 V7 T'k vv rpk on rpn T>k rpk T>n rpk T>n 

zv [« v i] J Im V « J lm D ij — 1 lm n nij 1 nm n Uj 1 ln n miy 

(5.10.18) 

If g is any metric tensor eld, the above identity implies that 

R(ij)kt = ^[k^l]9ij — m9ijS"kf 

4. The torsion tensor S and curvature tensor R satisfy the following identities: 

S\jk) = °> = Rt j[kl;m] ~ Rt jn[kS n im]' (5.10.19) 

R1 j(ke) = 0> R \jM] = -S % \jk-,i] + S z m yS™ e y (5.10.20) 

In the torsion free case, these identities reduce to the cyclical identity R t y k £] = 
and Bianchi's identity R t j^ t i-m] = ® - 

The following results hold for any pseudo-Riemannian manifold M with a met- 
ric tensor eld g^ : 

1 . A unique connection V called the Levi-Civita or pseudo-Riemannian connec- 
tion with vanishing torsion (S*j k = 0) exists that satis es Vigj k = 0. It 
follows that Vigi k = 0. Christoffel symbols of the first kind. The connec- 
tion coef cien ts of V, called the Christoffel symbols of the second kind, are 
given by = g u [jk,£], where [jk,£] = \{gji, k + guj - g jk ,i) are the 
T )k = ^j( lo S5) = \9\~^dj\g\^ wdg ijtk = [ki,j] + [kjj]. 
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2. The operations of raising and lowering indices commute with the covariant 
derivative. For example if X, = gijXi , then V^Xj = gijVkX^. 

3. The divergence of a vector X 1 is given by V«X* = |<7|~^<9j(|<7|5X*). 

4. The Laplacian of a scalar invariant / is given by 

5. The equations of an af nely parameterized geodesic may be written as 

6. Let X* and Y 8 be the components of any vector elds which are propagated 
in parallel along any parameterized curve 7. Then j^(gijX l Y^) = 0, which 
implies that the inner product <?y X*Y J is constant along 7. In particular, if x l 
are the components of the tangent vector to 7, then gijX l x^ is constant along 7. 

7. The Riemann tensor, de ned by R^u = 9imR"jke' * s gi yen by 

fly/u = -[?'*, »],/+[^,m]r7 /fe - [ik,m]r™ e 

= 2^H,jk + 9jk,U — 9jl,ik ~ 9ik,jl) (5.10.21) 

+ g mn ([i£,m][jk,n}-[ik,m}[j£,n}). 
It has the following symmetries: 

Rij(ki) = R(ij)u = Oj Rijki = RkUj, and Ri[ju\ = 0. (5.10.22) 
Consequently it has a maximum of n 2 (n 2 — 1)/12 independent components. 

8. The equations Rijti = are necessary and suf cient conditions for M to be 
aflat pseudo-Riemannian manifold, that is, a manifold for which a coordinate 
system exists so that the components g^ are constant on M. 

9. The Ricci tensor is given by 

Rij = dj^ k ik ~ ®kF k ij + ^ k u^ l kj ~ ^%^ l ki 

= ^(log \ g \) - V^iog M) - d k r% + r k im r™. 

It possesses the symmetry = Rji, and thus has a maximum of n(n + 1) /2 
independent components. 

10. The scalar curvature or curvature invariant is de ned by R = g y . 

11. The Einstein tensor is de ned by Gy = R^ — \Rg%j- In view of the Bianchi 
identity, it satis es: g jk V ' jGu = 0. 

o 

12. A normal coordinate system with origin xoeM is de ned by g^ x J = gijX J , 

where a "0" af x ed over a quantity indicates that the quantity is evaluated 

o 

at xo. The connection coef cients satisfy ^ t (j 1 j 2 ,j 3 —j r ) = (for r = 2, 3, . . . ) 
in any normal coordinate system. The equations of the geodesies through x o 
are given by x % = sk\ where s is an af ne parameter and k % is any constant 
vector. 
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5.10.6 EXAMPLES OF TENSORS 

1 . The components of the gradient of a scalar invariant Jj£ de ne a tensor of 
type (0,1), since they transform as J^j- = J^ffr- 

2. The components of the tangent vector to a parameterized curve de ne a 



tensor of type (1,0), because they transform as = ffj- 



3. The determinant of the metric tensor g de nes a relative scalar invariant of 



weight of w = 2, because it transforms as g 



dx 1 



3iJ 



2 



4. The Kronecker deltas Sj are the components of a constant absolute tensor of 
type (1, 1), because 8) = <5f fprfp-. 

5. The permutation symbol de ned by 

1, if i\ ■ ■ ■ i n is an even permutation of 1 • • • n, 
— 1, if i\ ■ ■ ■ i n is an odd permutation of 1 • • • n, and 
otherwise, 

(5.10.23) 

satis es ||r ej 1 ...j n = ..., n • • • ||^- . Hence it de ne s a tensor of type 

(0, n, —1), that is, it is a relative tensor of weight w = —1. The contravariant 
permutation symbol e n , de ned in a similar way, is a relative tensor of 
weight w = 1. 

6. The Levi-Civita symbol, ejj...j n = \g\i ei 1 ...i n , de nes a covariant absolute 
tensor of valence n. The contravariant Levi-Civita tensor satis es 

e h-i„ = g hh . ..,/.,/■• (;r .. ; . = (-l)^^-^ 1 -*". (5.10.24) 

Using this symbol, the dual of a covariant skew-symmetric tensor of valence 
risdened by *T il ... i „_ r = " '"'i, ...... . 

7. Cartesian tensors: Let M = E 3 (i.e., Euclidean three-space) with metric 
tensor <?y = Sij with respect to Cartesian coordinates. The components of a 
Cartesian tensor of valence r transform as 

^h-'-ir — ^j'i --jv ji ' j r ; (5.10.25) 

where are the components of a constant orthogonal matrix which satis es 
(0 _1 )y = (0 T )y = Oji. For Cartesian tensors, all indices are written as co- 
variant, because no distinction is required between covariant and contravariant 
indices. 

An oriented Cartesian tensor is a Cartesian tensor where the orthogonal ma- 
trix in the transformation law is restricted by det(Oy ) = 1. The Levi-Civita 
symbol e^k is an example of an oriented Cartesian tensor as is the cross prod- 
uct, (X x Y)i = eijkXjYk, of two vectors. The connection coef cients satisfy 
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T l j k = in every Cartesian coordinate system on E 3 . Thus the partial deriva- 
tives of Cartesian tensors are themselves Cartesian tensors, that is, if T il ... ir 
is a Cartesian tensor, then so is duT^...^. A particular example is the curl of 
a vector eld X, given by (curlX)j = Cij k djX k which de nes an oriented 
Cartesian tensor. 

8. Note the useful relations: e ijk e k i m = S a S jm - S im Sji, e ik ie k i m = 2S im , and 

tijk^lmn — ^U^jm^kn ~r" ^im^jn^kl ~r" ^in^jl^km ^in^jm^kl ^im^jl^kn 
^U^jn^km- 

9. The stress tensor E^ and the strain tensor e,j are examples of Cartesian ten- 
sors. 

10. Orthogonal curvilinear coordinates: Let M be a 3-dimensional Riemannian 
manifold admitting a coordinate system [x 1 , x 2 , x 3 ] such that the metric tensor 
has the form gu = h 2 (x 1 ,x 2 , x 3 ) for i = 1, ... ,3 with g^ = g tj = for 
i ^ j. The metric tensor on i? 3 has this form with respect to orthogonal 
curvilinear coordinates. The non-zero components of various corresponding 
quantities corresponding to this metric are as follows: 

(a) Covariant metric tensor 

g n = hi 2 , g 22 = h 2 2 , 922 = h 3 2 (5.10.26) 

(b) Contravariant metric tensor 

g ll =hi~ 2 , g 22 = h 2 ~ 2 , g 33 = h 3 ~ 2 (5.10.27) 

(c) Christoffel symbols of the rst kind (note that [ij, k] = if i, j, and k 
are all different), 



[11,1] 


= hihi : i 


[H,2] 


= ~hihi t 2 


[11,3] 


= -hi hi i3 


[12,1] 


= hihi fi 


[12,2] 


= h 2 h 2 ,i 


[13,1] 


= hihi fi 


[13,3] 


= h z h z ,i 


[22, 1] 


= -h 2 h 2A 


[22,2] 


= h 2 h 2fi 


[22,3] 


= -h 2 h 2 ,2 


[23,2] 


= h 2 h 2fi 


[23,3] 


= h 3 h 3 , 2 


[33, 1] 


= -h2h z ,i 


[33,2] 


= -h 3 h 3t2 


[33,3] 


= h 3 h 3t3 . 



(d) Christoffel symbols of the second kind (note that r* ■ = if i, j, and k 
are all different), 



ll 

11 


= hi 1 hi t i 


r 1 

1 12 


= /ll _1 /ll,2 


r 1 

1 13 


= hi 1 hi t 3 


ll 

22 


= —hi~ 2 h 2 h 2 ,i 


1 33 


= -hi~ 2 h 3 h 3A 


r 2 
1 ii 


= —hih 2 ~ 2 hi t2 


i2 
12 


= h 2 ~ l h 2 ,i 


r 2 

1 22 


= /l2 _1 /l2,2 


r 2 

1 23 


= h 2 ~ l h 2fi 


i2 
33 


= -h 2 ~ 2 h 3 h 3 , 2 


r 3 
1 ii 


= -hih 3 ~ 2 hi, 3 


r 3 

1 13 


= /i3 _1 /i3,i 


i3 
22 


= -h 2 hz~ 2 h 2fi 


r 3 

1 23 


= hz~ l h zfi 


r 3 

1 33 


= /l3 -1 /l3,3- 
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(e) Vanishing Riemann tensor conditions (Lame equations), 



11,2,3 — 


IT>2 /il,2/i2,3 — 


13 


/ii, 3/13,2 


n 

— u, 


/l2,l,3 — 


/ll -1 /ll,3/l2,l - 


h 3 


1 /*3, 1^2,3 


= 0, 


h 3 ,l,2 — 


/ll _1 /ll i2 /l3,l - 


h 2 


1 /l2, l/l3,2 


= 0, 




+ h 3 h 3 - 2 - 2 + hi 


-2 


/l2/l3/l2,l/l3 


,1 — 








h 2 h 3 ~ 1 h 2 ,3 


/l3,3 



/ll/ll,3,3 + /l3/l3,l,l + /ll/l2 2 /l3/ll, 2/l3,2 - /ll 1 /l3^1, l/l3,l 

— /ll/l3 _1 /ll, 3/13,3 = 0, 

/ii/ii,2,2 + Zi2/i2,i,i + /ii/i 2 /i3~ 2 /ii, 3/12,3 - h 1 ~ 1 h 2 h 1A h 2 ,i 

- /ll/l2 _1 /ll, 2/l2,2 = 0. 

1 1 . 77ze 2-sphere: A coordinate system [#, (/>] for the 2-sphere a; 2 + y 2 + = r 2 is 
given by 2; = r sin # cos <f>, y = r sin9 sin <f>, z = r cos #, where [#, € J7 = 
(0,7r) x (0,27r). This is a non-Euclidean space. The non-zero independent 
components of various quantities de ned on the sphere are given below: 

(a) Covariant metric tensor components are gin = r 2 , (722 = ?* 2 sin 2 6. 

(b) Contravariant metric tensor components are g 11 =r~ 2 ,g 22 = r~ 2 esc 2 #. 

(c) Christoffel symbols of the rst kind are [12, 2] = r 2 sin 6> cos 9, 
[22,1] = -r 2 sin cos 0. 

(d) Christoffel symbols of the second kind are T \ 2 = — sin 9 cos 0, 
T 2 12 = — cos 9 esc 9. 

(e) Covariant Riemann tensor components are R \ 2 \ 2 = r 2 sin 2 9. 

(f) Covariant Ricci tensor components are — — 1, ^22 — — sin 9. 

(g) Ricci scalar is R = —2r~ 2 . 

12. The 3-sphere: A coordinate system [ip, 9, <f>] for the 3-sphere x 2 + y 2 + z 2 + 
w 2 = r 2 is given by a; = r sin ip sin 9 cos (j>, y = r simp sin 9 sin (f>, z = 
r simp cos9, and w = rcostp, where [tp, 9,(p] € U = (0,7r) x (0,7r) x (0, 2tt). 
The non-zero components of various quantities de ned on the sphere are given 
below: 

(a) Covariant metric tensor components 

9n=r 2 , g 22 = r 2 sin 2 ip, g 33 = r 2 sin 2 ip sin 2 9 (5.10.28) 

(b) Contravariant metric tensor components 

11 —2 22 —2 2/ 33 —2 2 ; 2 n 

g =r , g =r esc ip, g < =r esc ip esc 9 

(5.10.29) 
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(c) Christoffel symbols of the rst kind, 

[22, 1] = — r 2 sin^ cos^ [33, 1] = — r 2 sin ip cos ip sin 2 9 

[12, 2] = r 2 sin ^ cos ^ [33, 2] = — r 2 sin 2 ip sin # cos # 

[13, 3] = r 2 sin ip cos ^ sin 2 # [23, 3] = r 2 sin 2 ip sin# cos#. 

(d) Christoffel symbols of the second kind, 

T\ 2 = — sin ip cos ip T\ 3 = — sin ip cos ^ sin 2 # 

T 2 12 = cot^ r 2 33 = — sin # cos # 

r 3 13 =cotV' r 3 23 =cot6». 

(e) Covariant Riemann tensor components, 

#1212 = r 2 sin 2 ip, i?i3i 3 = r 2 sin 2 ^ sin 2 9, R 23 23 = ?* 2 sin 4 ip sin 2 

(f) Covariant Ricci tensor components, 

i?n = -2, i? 22 = -2 sin 2 V>, i? 33 = -2 sin 2 V> sin 2 9 . 

(g) The Ricci scalar is R = -6r~ 2 . 

(h) Covariant Einstein tensor components 

Gn = 1, G 22 = sin 2 V>, G 33 = sin 2 V> sin 2 6> (5.10.30) 

13. Polar coordinates: The line element is given by ds 2 = dr 2 + r 2 d9 2 . Thus the 
metric tensor is <?y = ^ J ® 2 ^ > an d me non-zero Christoffel symbols are 
[21,2] = [12,2] = -[22,1] =r. 



5.1 1 ORTHOGONAL COORDINATE SYSTEMS 

In an orthogonal coordinate system, let {a,} denote the unit vectors in each of the 
three coordinate directions, and let {u{\ denote distance along each of these axes. 
The coordinate system may be designated by the metric coefficients {gn, 922, 933}, 
de ned by 




(5.11.1) 



where {x\,X2,x 3 } represent rectangular coordinates. Thende ne g = gng22g33- 

Operations for orthogonal coordinate systems are sometimes written in terms 
of the {hi} functions, instead of the {gu} functions. Here, /i, = ^JgTi, so that 
sjg = hi 7*2/13 • For example, in cylindrical coordinates, {x\ = r cos 9, X2 = r sin 9, 
x 3 = z} with {m =r,u 2 = 9, u 3 = z}, we nd {g u = 1, #22 = r 2 , g 33 = 1} so 
that {hi = l,h 2 = r, h 3 = 1}. 
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In the following, <f> represents a scalar, and E = E\&i + E2&2 + E 3 a 3 and 
F = Fi&i + F2H2 + F 3 a 3 represent vectors. 



grad <f> 



divE 



curlE 



V<fi = the gradient of <f> 
ai d(j> &2 d(j> a 3 d(j> 

y/fjU. dui y/g2~2 du 2 y/m du z ' 

V • E = the divergence of E 

y/g \ dm V 5n / du 2 V 522 J du 3 

V x E = the curl of E 



ai 



/511 



+ a 2 - 



ai 

a 

h x E x 



hi hs 

d 

dU2 

I12E2 



[(F-V)E] i = ^ 



i=l 



F\ dEj 



+ 



'922 



h\h2 

d 
du 3 

h 3 E 3 

Ei 
hihj 



+ a 3 - 



/g33 



F d Jh. 

3 dm 



dhj 
1 diij 



the Laplacian of <j> (sometimes written as A<f>) 



gE 3 
533 



_l j 9 

11/12/13 I du 1 



(5.11.2) 

(5.11.3) 

(5.11.4) 
(5.11.5) 
(5.11.6) 



hi 

_L { 9 



7*2/13 d<j) 


9 


h 3 h\ d<j) 


9 

du 3 


/11/12 d<j) 


hi dui 


du 2 


/l2 9U2 


h 3 du 3 



gn dui 



+ 



9 



graddivE = V(V • E) 



du2 

ai 9X 

fgudxi 



\fg d(p 

g22 9u 2 



+ 



9 



du 3 
a 2 9T 



\/5 d<P_ 

.533 9u 3 

a 3 9T 

522 9x 2 ' 1/533 9x 3 ' 



+ 



(5.11.7) 
(5.11.8) 



curl curl E 



V x (V x E) 

jgzz 

g 



ai 



+ a 3 




9r 3 

9x 2 
dT 2 
dxi 



dT2 

dx 3 
8x2 



+ a 2 




d£i 

dx 3 



dT 3 
dxi 



x£xE = grad div E — curl curl E = the vector Laplacian of E 
= V(V • E) - V x (V x E) 



\x/g 



9X 



+ a 2 



+ a 3 





dx 1 


1 


ax 


1/522 


9x 2 


1 


ax 


1/533 


dx 3 



+ 




5n 
5 

/52J [9Ts _ sti 1 1 

V 5 9x 3 J J 
/5s7 \d£i _ 0T2 1 1 

V 5 |_9x 2 9xi J J ' 



dT 2 
dx 3 
9T, 
dxi 
STi 
9x 2 



9r 3 

9x 2 
9Ti 

9x 3 

9r 2 

9xi 



(5.11.9) 



(5.11.10) 
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where T and T = (fi, T 2 , T 3 ) are de ned by 




5.1 1 .1 TABLE OF ORTHOGONAL COORDINATE SYSTEMS 

The {/,} listed below are the separated components of the Laplace or Helmholtz 
equations (see (5.7.18) and (5.7.19)). See Moon and Spencer for details. 

The corresponding equations for the four separable coordinate systems which 
exist in two dimensions may be obtained from the coordinate systems 1-4 listed 
below by suppressing the z coordinate and assuming that all functions depend only 
on the x and y coordinates. 



1 . Rectangular coordinates {x, y, z} 

Ranges: — oc < x < oo, — oo < y < oo, — oo < z < oo. 

gil = 922 = 533 = y/g = l. 

h = h = h = 1. 



In this coordinate system the following notation is sometimes used: 

1 = a x> j = a j/> k = a z- 

df df df 
grad / = a x -i- + a y -i- + a, -i- 

ox ay 

divE = A (£lf) + |. ( ^ ) + ^ ) 

curlE=f^-^W(^-^W^ ^ 



<9y dz J \ dz dx J \ dx dy 

2 a*f a*f a*f 

V ' " dx* + dy* + dz* (5.11.12) 



r/T , _ ^ 3^ ^ 5^ ^ dE x 
[(F-V)E L =F^ + F^ + F Z ^ 



2. Circular cylindrical coordinates {r, #, 

Relations: x = r cos #, y = r sin #, z = z. 
Ranges: < r < 00, < # < 2tt, —00 < z < oc. 
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ffn = 1, #22 = r 2 , g 33 = 1, y/g = r, 
fi = r, h=h = 1. 



df a e df df 
or r 89 Oz 

,. „ is, n , i as 



(curlE) r 
(curlE) e 
(curlE), 



r dr r 89 dz 

1 dE z dEff 



r 88 dz ,„ , , , „ N 

i a(rs e ) i as r 



r <9r r 89 

V 2 / - 1— (V^O + — ^ + 

r dr \ dr I r 2 89 2 dz 2 



3. Elliptic cylindrical coordinates {r],tp,z} 
Relations: x = a cosh ^ cos ip, y = asmhrjsmtp, z = z. 
Ranges: 0<r?<oo,0<^< 2tt, — oo < z < oo. 

ffn = #22 = a 2 (cosh 2 77 - cos 2 ip), g 33 = 1, = a 2 (cosh 2 rj - cos 2 ip), 

h=h = h = i. 

4. Parabolic cylindrical coordinates {/x, i/, 2} 
Relations: x = \(ii 2 — v 2 ), y = [iv, z = z. 
Ranges: < fi < 00, —00 < v < 2ir, —00 < z < 00. 
#11 = #22 = jU 2 + i/ 2 , 533 = 1, y/g = ii 2 + v 2 , 

h=h = h = 1. 

5. Spherical coordinates {r, 9, ip} 

Relations: x = r sin 9 cos ^, y = r sin # sin <f>, z = r cos #. 

Ranges: < r < 00, < 6* < tt, < ^ < 2tt. 

#11 = 1, #22 = r 2 , g 33 = r 2 sin 2 9,^fg = r 2 sin#, 
fi =r 2 ,f 2 =sin9,f 3 = 1. 
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grad/ = e r — H — H r^^r 

or r 09 r sin 



divE 
(curlE) r 
(curlE) fl 
(curl E) 4, 



1 



— — (r 2 E r ) + , 
r z Or r sin cw 



(Eg sm0) + 



1 ag^ 

rsin# d(j> 



1 



r sinl 
1 



9 ftp • m 
-(^sm^)- — 

<9£ r 1 dirEf) 



rsmti 04 
ld(rE e ) 
r 



dr 



1 d 



V7 = ^i- + 



r 2 <9r 



3/ 



<9r 



r <9r 

1 <9£ r 

r~dT 

1 



5 



r 2 sin <9# 



(5.11.14) 



a 2 / 



r 2 sin 2 



00^ 



6. Prolate spheroidal coordinates {rj, 9, ip} 

Relations: x = a sinh rj sin 9 cos ip,y = a sinh 77 sin # sin ip, z = a cosh rj cos 0. 

Ranges: 0<r?<oo,0<6»<7r, 0<V<2tt. 

ffn = 522 = a 2 (sinh 2 r] + sin 2 9) 933 = a 2 sinh 2 »j sin 2 9, 
^fg = a 3 (sinh 2 r] + sin 2 9) sinh 77 sin #. 

/1 = sinhr;, / 2 = sin#, / 3 = a. 

7. Oblate spheroidal coordinates {77, 6>, ^} 

Relations: x = a cosh rj sin 9 cos tp , y = a cosh 77 sin # sin ip, z = a sinh 77 cos 9 . 

Ranges: < 77 < 00, < 6> < 7r, < ip < 2tt. 

911 = 922 = a 2 (cosh 2 77 — sin 2 9) (733 = a 2 cosh 2 77 sin 2 9, 
y/g = a 3 (cosh 2 77 — sin 2 9) cosh 77 sin #. 

/1 = cosh 77, f 2 = sin 9, f 3 = a. 

8. Parabolic coordinates {/i, v, ip} 

Relations: x = [iv cos ip, y = [iv sin ip, z = \(ii 2 — v 2 ). 
Ranges: < n < 00, < v < 00, < ip < 2tt. 
911 = 922 = ju 2 + v 2 933 = V9 = VHP 2 +v 2 )- 

fi = V, h =v,fo = 1. 

9. Conical coordinates {r, 9, A} 

Relations: x 2 = (r9X/bc) 2 , y 2 = r 2 (9 2 - b 2 )(b 2 - X 2 )/[b 2 (c 2 - b 2 )}, z 2 = 
r 2 (c 2 - 9 2 )(c 2 - A 2 )/[c 2 (c 2 -b 2 )}. 

Ranges: < r < 00, b 2 < 9 2 < c 2 , < A 2 < b 2 . 
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9n = 1, 922 = r 2 (9 2 - X 2 )/((9 2 - b 2 )(c 2 - 9 2 )), 

g33 = r 2 (9 2 - A 2 )/(( 6 2 -A 2 )(c 2 -A 2 )), 

^/g = r 2 (9 2 - X 2 )/y / (9 2 - b 2 ){c 2 - 9 2 ){b 2 - A 2 )(c 2 - A 2 ). 

fi = r 2 , h = V(0' 2 -b 2 )(c 2 -9 2 ), f z = V(6 2 -A 2 )(c 2 -A 2 ). 

10. Ellipsoidal coordinates {n, 9, A} 

Relations: x 2 = (rflX/bc) 2 , y 2 = (r, 2 - b 2 ){9 2 - b 2 )(b 2 - X 2 )/[b 2 (c 2 - b 2 )}, 
= ( v 2 - c 2 )(c 2 - 9 2 )(c 2 - A 2 )/[c 2 (c 2 - b 2 )]. 

Ranges: c 2 <r\ 2 < oo, b 2 < 9 2 < c 2 , < A 2 < b 2 . 

9ii = (V 2 ~ 2 )(v 2 ~ A 2 )/((r? 2 - b 2 )( V 2 - c 2 )), 
g22 = i e 2 -\ 2 )(r, 2 - 9 2 )/((9 2 -b 2 )(c 2 -9 2 )), 
9ss = (r 1 2 -X 2 )(9 2 -X 2 )/((b 2 -X 2 )(c 2 -X 2 )), 

(r, 2 -9 2 )(r 1 2 -\ 2 )(e 2 -\ 2 ) 



V9 



^/(r 1 2 -b 2 )(r 1 2 -c 2 )(0 2 -b 2 )(c 2 -0 2 )(b 2 -\ 2 )(c 2 -\ 2 ) ' 



fi = V(y 2 -b 2 )(r, 2 f 2 = y/{9 2 -b 2 ){c 2 -9 2 ), 

h = ^/(b 2 -X 2 )(c 2 -X 2 ). 

11. Paraboloidal coordinates {/i, v, A} 

Relations: x 2 = 4(p - b)(b - v){b - X)/(b - c), 

y 2 = 4(/i - c)(c - i/)(A - c)/(b - c), z 2 = ii + v + X - b - c. 

Ranges: 6<ju<oo,0<^<c, c < A < 6. 

<7ii = (n-v)(n-X)/((n-b)(n-c)),g 2 2 = (n~v)(X-v) / ((b-v)(c-v)), 
933 = (A-z,)(/i-A)/((fo-A)(A-c)), Jg = -. 

fi = ^(ji-b^-c), h = y/{b-v)(c-v), h = V(b-X)(X-c). 



5.12 CONTROL THEORY 

Let x be a state vector, let y be an observation vector, and let u be the control. The 
vectors x, y, and u have n, to, and p components, respectively. If a system evolves 
as: 

x = Ax + Bu 

(5.12.1) 

y = Cx + Du 

then, taking Laplace transforms, y = G(s)u where G(s) is the transfer function 
given by G(s) = C(sl - A)' 1 B + D. 

A system is said to be controllable if and only if for any times {t o , t\ } and any 
states {xo,Xi} there exists a control u(t) such that x(to) = xo and x(ii) = Xi. The 
system is controllable if and only if 

rank [5 AB A 2 B ... A n ~ 1 B] = n. (5.12.2) 
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If, given u(t) and y(t) on some interval to < t < t\, the value of x(t) can be 
deduced on that interval, then the system is said to be observable. Observability is 
equivalent to the condition 

rank[<7 T A T C T ... (A(«" 1 )) T C T ] = n. (5.12.3) 

If the control is bounded above and below (say u~ < u« < uf ), then a bang- 
bang control is one for which Uj = u~ or = uf . (That is, for every t, either 
Ui(t) = u~(t) or Ui(t) = uf(t); switches are possible.) A bang-off-bang control is 
one for which = 0, = u~ , or = uf . 

A second frequently studied control problem is x = f(x, u, t), where x(i ) and 
x(tf) are speci ed, and there is a cost function, J = (f>(x, u, t). The goal is to 
minimize the cost function. De ning the Hamiltonian H(x, z, u, t) = <f> + z • f , the 
optimal control (the one that minimizes the cost function) satis es 

• OH . dH n dH 
az ax ou 

EXAMPLE In the one-dimensional case, with x = —ax + u, x(0) = xo, x(oo) = 0, 

and J = / °°(^ 2 + u 2 ) dt; the optimal control is given by u = (a — vl + a 2 )x*(t) 

where x*(t) = x e~^ 1+a2t . 
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4.1 COORDINATE SYSTEMS IN THE PLANE 



4.1.1 CONVENTION 

When we talk about "the point with coordinates (x, y)" or "the curve with equation 
y = f(x)", we always mean Cartesian coordinates. If a formula involves other 
coordinates, this fact will be stated explicitly. 



4.1 .2 SUBSTITUTIONS AND TRANSFORMATIONS 

Formulae for changes in coordinate systems can lead to confusion because (for ex- 
ample) moving the coordinate axes up has the same effect on equations as moving 
objects down while the axes stay x ed. (To read the next paragraph, you can move 
your eyes down or slide the page up.) 

To avoid confusion, we will carefully distinguish between transformations of 
the plane and substitutions, as explained below. Similar considerations will apply to 
transformations and substitutions in three dimensions (Section 4.8). 



4.1.2.1 Substitutions 

A substitution, or change of coordinates, relates the coordinates of a point in one 
coordinate system to those of the same point in a different coordinate system. Usually 
one coordinate system has the superscript ' and the other does not, and we write 

{ X = F{x<y<) or { ^ y)=F{x ^ yl) (4U) 

[y = Fy(x',y'), 

(where subscripts and primes are not derivatives, they are coordinates). This means: 
given the equation of an object in the unprimed coordinate system, one obtains 
the equation of the same object in the primed coordinate system by substituting 
F x (x' , y') for x and F y (x' , y') for y in the equation. For instance, suppose the primed 
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coordinate system is obtained from the unprimed system by moving the x axis up a 
distance d. Then x = x' and y = y' + d. The circle with equations x 2 + y 2 = 1 in 
the unprimed system has equations x' 2 + (y' + d) 2 = 1 in the primed system. Thus, 
transforming an implicit equation in (a;, y) into one in (x' , y') is immediate. 

The point P = (a, b) in the unprimed system, with equation x = a, y = b, 
has equation F x (x' ,y') = a, F y (x', y') = b in the new system. To get the primed 
coordinates explicitly, one must solve for x' and y' (in the example just given we 
have x' = a, y' + d = b, which yields x' = a, y' = b — d). Therefore, if possible, 
we give the inverse equations 

, n , , or (x ,y) = G{x,y), 

y = G yl (x,y) 

which are equivalent to Equation(4.1.1)ifG(F(x',?/')) = (x',y') and F(G(x, y)) = 
(x, y). Then to go from the unprimed to the primed system, one merely inserts the 
known values of x and y into these equations. This is also the best strategy when 
dealing with a curve expressed parametrically, that is, x = x(t), y = y(t). 



4.1.2.2 Transformations 

A transformation associates with each point (x, y) a different point in the same co- 
ordinate system; we denote this by 

(x,y)^ F(x,y), (4.1.2) 

where F is a map from the plane to itself (a two-component function of two vari- 
ables). For example, translating down by a distance d is accomplished by (x, y) h-> 
(x, y — d) (see Section 4.2). Thus, the action of the transformation on a point whose 
coordinates are known (or on a curve expressed parametrically) can be immediately 
computed. 

If, on the other hand, we have an object (say a curve) de ned implicitly by the 
equation C(x, y) = 0, nding the equation of the transformed object requires using 
the inverse transformation 

(x,y)^G(x,y) (4.1.3) 

de ned by G(F(x,y)) = (x,y) and F(G(x,y)) = (x,y). The equation of the 
transformed object is C(G(x, y)) = 0. For instance, if C is the circle with equation 
x 2 + y 2 = 1 and we are translating down by a distance d, the inverse transformation 
is (x,y) h-> (x, y + d) (translating up), and the equation of the translated circle is 
x 2 + (y + d) 2 = 1. Compare to the example following Equation (4.1.1). 



4.1 .2.3 Using transformations to change coordinates 

Usually, we will not give formulae of the form (4.1.1) for changes between two coor- 
dinate systems of the same type, because they can be immediately derived from the 
corresponding formulae (4.1.2) for transformations, which are given in Section 4.2. 
We give two examples for clarity. 
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FIGURE 4.1 

Change of coordinates by a rotation. 




Let the two Cartesian coordinate systems (x,y) and (x',y') be related as fol- 
lows: They have the same origin, and the positive a; '-axis is obtained from the pos- 
itive 2;-axis by a (counterclockwise) rotation through an angle 8 (Figure 4.1). If a 
point has coordinates (x,y) in the unprimed system, its coordinates (x',y') in the 
primed system are the same as the coordinates in the unprimed system of a point that 
undergoes the inverse rotation, that is, a rotation by an angle a = —8. According to 
Equation (4.2.2) (page 305), this transformation acts as follows: 



(x,y) \-> 



cos 8 sin 8 
- sin 8 cos 8 



(x,y) = (xcosd + ysind, —xsin8 + ycos8). (4.1.4) 



Therefore the right-hand side of Equation (4.1.4) is (x' , y'), and the desired substi- 
tution is 

x' = x cos 8 + y sin 8, 

(4.1.5) 

y = —xsin8 + y cos8. 

Switching the roles of the primed and unprimed systems we get the equivalent 
substitution 

x = x cos 8 — y 1 sin#, 

, (4-1.6) 
y = x sin 8 + y cos 8 

(because the rc-axis is obtained from the a; '-axis by a rotation through an angle —8). 

Similarly, let the two Cartesian coordinate systems (x,y) and (x' ,y') differ by 
a translation: x is parallel to x' and y to y 1 , and the origin of the second system 
coincides with the point (xo,yo) of the rst system. The coordinates (x,y) and 
(x' , y') of a point are related by 



x = x 1 + Xo , 
V = y' + 2/o, 



x 

y' 



y - yo- 



(4.1.7) 



4.1 .3 CARTESIAN COORDINATES IN THE PLANE 

In Cartesian coordinates (or rectangular coordinates), the "address" of a point P is 
given by two real numbers indicating the positions of the perpendicular projections 
from the point to two x ed, perpendicular, graduated lines, called the axes. If one 
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coordinate is denoted x and the other y, the axes are called the x-axis and the y-axis, 
and we write P = (x,y). Usually the a>axis is horizontal, with x increasing to the 
right, and the y-axis is vertical, with y increasing vertically up. The point x = 0, 
y = 0, where the axes intersect, is the origin. See Figure 4.2. 



FIGURE 4.2 

In Cartesian coordinates, Pi = (4,3), Pi = (—1.3,2.5), P3 = (—1.5,-1.5), P4 = 
(3.5, —1), and P 5 = (4.5, 0). The axes divide the plane into four quadrants. Pi is in the 
r st quadrant, P 2 in the second, P3 in the third, and Pa in the fourth. P 5 is on the positive 
x-axis. 



y 



Pi 3 




• 1 
P5 




2 
1 


-2 


-1 

-1 


12 3 


4 5 
Pa 




P3 -2 





4.1 .4 POLAR COORDINATES IN THE PLANE 

In polar coordinates a point P is also characterized by two numbers: the distance 
r > to a xed pole or origin O, and the angle 8 that the ray OP makes with a x ed 
ray originating at O, which is generally drawn pointing to the right (this is called the 
initial ray). The angle 9 is de ned only up to a multiple of 360 or 2tt radians. In 
addition, it is sometimes convenient to relax the condition r > and allow r to be a 
signed distance; so (r, 0) and (— r, + 180°) represent the same point (Figure 4.3). 



FIGURE 4.3 

Among the possible sets of polar coordinates for P are (10,30°), (10,390°) and 
(10, —330°). Among the sets of polar coordinates for Q are (2.5, 210°) and (—2.5, 30°). 
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4.1 .4.1 Relations between Cartesian and polar coordinates 

Consider a system of polar coordinates and a system of Cartesian coordinates with 
the same origin. Assume that the initial ray of the polar coordinate system coincides 
with the positive a;-axis, and that the ray = 90° coincides with the positive y-axis. 
Then the polar coordinates (r, 0) with r > and the Cartesian coordinates (x, y) of 
the same point are related as follows (x and y are assumed positive when using the 
tan -1 formula): 

x = rcos8, Jr = \/x 2 + y 2 , 

y = rsiri0, | = tan" 1 -, 

^ x 



4.1 .5 HOMOGENEOUS COORDINATES IN THE PLANE 

A triple of real numbers (x : y : t), with t ^ 0, is a set of homogeneous coordinates 
for the point P with Cartesian coordinates (x/t , y ft) . Thus the same point has many 
sets of homogeneous coordinates: (x : y : t) and (x' : y' : t') represent the same 
point if and only if there is some real number a such that x ' = ax, y' = ay , z' = az . 

When we think of the same triple of numbers as the Cartesian coordinates of 
a point in three-dimensional space (page 345), we write it as (x,y,t) instead of 
(x : y : t). The connection between the point in space with Cartesian coordinates 
(x,y,t) and the point in the plane with homogeneous coordinates (x : y : t) becomes 
apparent when we consider the plane t = 1 in space, with Cartesian coordinates 
given by the rst two coordinates x, y (Figure 4.4). The point (x,y,t) in space can 
be connected to the origin by a line L that intersects the plane t = 1 in the point with 
Cartesian coordinates (x/t, y/t) or homogeneous coordinates (x : y : t). 

Homogeneous coordinates are useful for several reasons. One of the most im- 
portant is that they allow one to unify all symmetries of the plane (as well as other 
transformations) under a single umbrella. All of these transformations can be re- 
garded as linear maps in the space of triples (x : y : t), and so can be expressed in 
terms of matrix multiplications (see page 306). 

If we consider triples (x : y : t) such that at least one of x,y,t is non-zero, 
we can name not only the points in the plane but also points "at in nity". Thus, 
(x : y : 0) represents the point at in nity in the direction of the ray emanating from 
the origin going through the point (x, y). 



4.1 .6 OBLIQUE COORDINATES IN THE PLANE 

The following generalization of Cartesian coordinates is sometimes useful. Consider 
two axes (graduated lines), intersecting at the origin but not necessarily perpendic- 
ularly. Let the angle between them be uj. In this system of oblique coordinates, a 
point P is given by two real numbers indicating the positions of the projections from 
the point to each axis, in the direction of the other axis (see Figure 4.5). The rst 
axis (x-axis) is generally drawn horizontally. The case uj = 90 ° yields a Cartesian 
coordinate system. 



sin# : 
cos# 



\/x 2 + y 2 
x 

\/x 2 + v 2 
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FIGURE 4.4 

The point P with spatial coordinates (x, y, i) projects to the point Q with spatial coordinates 
(x/t, y/t, 1). The plane Cartesian coordinates of Q are (x/t, y/t), and (x : y : t) is one set 
of homogeneous coordinates for Q. Any point on the line L (except for the origin O) would 
also project to Q. 




FIGURE 4.5 

In oblique coordinates, Pi = (4, 3), P 2 = (-1.3, 2.5), P s = (-1.5, -1.5), P 4 = (3.5, -1), 
and Ps = (4.5, 0). Compare to Figure 4.2. 




4.1 .6.1 Relations between two oblique coordinate systems 

Let the two oblique coordinate systems (x,y) and (x',y'), with angles uj and u/, 
share the same origin, and suppose the positive x'-axis makes an angle 6 with the 
positive x-axis. The coordinates (x, y) and (x' , y') of a point in the two systems are 
related by 

x' sin(w — &) + y' sin(w — tu' — 9) 

X = 

sinw 

x 1 sin + sin(w' +6) 

V = : 

smcj 



(4.1.8) 
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This formula also covers passing from a Cartesian system to an oblique system and 
vice versa, by taking oj = 90° or cj' = 90°. 

The relation between two oblique coordinate systems that differ by a translation 
is the same as for Cartesian systems. See Equation (4.1.7). 



4.2 PLANE SYMMETRIES OR ISOMETRIES 

A transformation of the plane (invertible map of the plane to itself) that preserves 
distances is called an isometry of the plane. Every isometry of the plane is of one of 
the following types: 

1 . The identity (which leaves every point x ed) 

2. A translation by a vector v 

3. A rotation through an angle a around a point P 

4. A re ection in a line L 

5. A glide-re e ction in a line L with displacement d 

Although the identity is a particular case of a translation and a rotation, and re ec- 
tions are particular cases of glide-re ections, it is more intuitive to consider each 
case separately. 



4.2.1 FORMULAE FOR SYMMETRIES: CARTESIAN 
COORDINATES 

In the formulae below, a multiplication between a matrix and a pair of coordinates 
should be carried out regarding the pair as a column vector (or a matrix with two 
rows and one column). Thus [° ^] (x, y) = (ax + by, cx + dy). 



1 . Translation by (xq , yo ) : 

(x,y) i ^ (x + x , y + yo)- 

2. Rotation through a (counterclockwise) around the origin: 



(x,y) 



cos a 
sin a 



■ sin a; 
cos a 



(x,y)- 



(4.2.1) 



(4.2.2) 



3. Rotation through a (counterclockwise) around an arbitrary point (x o, yo)'- 



(x,y) i y (x ,yo) + 
4. Re ec Hon: 



cos a 
sin a 



- sin a; 
cos a 



(x -x , y - yo)- 



in the x-axis: 
in the y-axis: 
in the diagonal x = y: 



(x,y) i ^ (x, -y), 
(x,y) i ^ (-x, y), 
(x,y) h-> (y,x). 



(4.2.3) 



(4.2.4) 
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5. Re ec tion in a line with equation ax + by + c = 0: 



(x,y) \-> 



1 



i 2 + b 2 



b 2 - a 2 



-2ab 



(x,y) - (2ac,2bc) . (4.2.5) 



6. Re ec tion in a line going through (xo,yo) an d making an angle a with the 
x-axis: 



(x,y) i ^ (a; ,yo) + 



cos 2a sin 2a 
sin 2a — cos 2a 



(x-x ,y-y ). (4.2.6) 



7. Glide-re ection in a line L with displacement d: Apply rst a re ection in L, 
then a translation by a vector of length d in the direction of L, that is, by the 
vector 



1 



a 2 + b 2 

if L has equation ax + by + c = 0. 



(±ad, =fbd) 



(4.2.7) 



4.2.2 FORMULAE FOR SYMMETRIES: HOMOGENEOUS 
COORDINATES 

All isometries of the plane can be expressed in homogeneous coordinates in terms 
of multiplication by a matrix. This fact is useful in implementing these transforma- 
tions on a computer. It also means that the successive application of transformations 
reduces to matrix multiplication. The corresponding matrices are as follows: 

1 . Translation by (xq , yo ) : 



1 x 
1 







yo 
l 



(4.2.8) 



2. Rotation through a around the origin: 



R a 



cos a 
sin a 




- sin a 
cos a 
1 



(4.2.9) 



3. Re ec tion in a line going through the origin and making an angle a with the 

2>axis: 

cos 2a sin 2a 
M a = sin 2a -cos 2a . (4.2.10) 
1 



From this one can deduce all other transformations. 
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EXAMPLE To nd the matrix for a rotation through a around an arbitrary point P = 
(xo,yo), we apply a translation by — (xo,yo) to move P to the origin, a rotation 
through a around the origin, and then a translation by (xo, yo): 



T{x a ,y ) Ra T- ( XQ j!/0 ) 



cos a — sin a xo — xo cos a + yo sin a 
sin a cos a yo — yo cos a — xo sin a 
1 



(4.2.11) 



(notice the order of the multiplication). 



4.2.3 FORMULAE FOR SYMMETRIES: POLAR COORDINATES 

1. Rotation around the origin through an angle a: 

(r,0) ^ (r, 6 + a). (4.2.12) 



2. Re ec tion in a line through the origin and making an angle a with the positive 
a>axis: 

{r,6)^{r,2a-6). (4.2.13) 



4.2.4 CRYSTALLOGRAPHIC GROUPS 

A group of symmetries of the plane that is doubly in nite is a wallpaper group, 
or crystallographic group. There are 17 types of such groups, corresponding to 17 
essentially distinct ways to tile the plane in a doubly periodic pattern. (There are also 
230 three-dimensional crystallographic groups.) 

The simplest crystallographic group involves translations only (page 309, top 
left). The others involve, in addition to translations, one or more of the other types of 
symmetries (rotations, re ection s, glide-re ections). The Conway notation for crys- 
tallographic groups is based on the types of non-translational symmetries occurring 
in the "simplest description" of the group: 

1. ° indicates a translations only, 

2. * indicates a re ection (mirror symmetry), 

3. x a glide-re ection, 

4. a number n indicates a rotational symmetry of order n (rotation by 360 °/n). 

In addition, if a number n comes after the *, the center of the corresponding rotation 
lies on mirror lines, so that the symmetry there is actually dihedral of order 2n. 

Thus the group ** in the table below (page 309, middle left) has two inequivalent 
lines of mirror symmetry; the group 333 (page 311, top right) has three inequivalent 
centers of order-3 rotation; the group 22 * (page 309, bottom right) has two inequiv- 
alent centers of order-2 rotation as well as mirror lines; and *632 (page 311, bottom 
right) has points of dihedral symmetry of order 12(= 2 x 6), 6, and 4. 

The following table gives the groups in the Conway notation and in the notation 
traditional in crystallography. It also gives the quotient space of the plane by the 
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action of the group. The entry "4,4,2 turnover" means the surface of a triangular puff 
pastry with corner angles 45°(= 180°/4), 45° and 90°. The entry "4,4,2 turnover 
slit along 2,4" means the same surface, slit along the edge joining a 45 ° vertex to 
the 90° vertex. Open edges are silvered (mirror lines); such edges occur exactly for 
those groups whose Conway notation includes a * . 

The last column of the table gives the dimension of the space of inequivalent 
groups of the given type (equivalent groups are those that can be obtained from one 
another by proportional scaling or rigid motion). For instance, there is a group of 
type ° for every shape parallelogram, and there are two degrees of freedom for the 
choice of such a shape (say the ratio and angle between sides). Thus, the ° group of 
page 309 (top left) is based on a square fundamental domain, while for the ° group 
of page 311 (top left) a fundamental parallelogram would have the shape of two 
juxtaposed equilateral triangles. These two groups are inequivalent, although they 
are of the same type. 



Look on page 


Conway 


Cryst 


Quotient space 




Dim 


309 top left; 1 


o 


Pi 


Torus 




2 


311 top left J 








309 top right 


XX 


Pg 


Klein bottle 




1 


309 middle left 




pm 


Cylinder 




1 


309 middle right 


X* 


cm 


Mtibius strip 




1 


309 bottom left 


22 x 


Pgg 


Nonorientable football 




1 


309 bottom right 


22* 


pmg 


Open pillowcase 




1 


310 top left 


2222 


p2 


Closed pillowcase 




2 


310 top right 


2*22 


cmm 


4,4,2 turnover, slit along 


4,4 


1 


310 middle left 


*2222 


pmm 


Square 




1 


310 middle right 


442 


p4 


4,4,2 turnover 







310 bottom left 


4*2 


P4g 


4,4,2 turnover, slit along 


4,2 





310 bottom right 


*442 


p4m 


4,4,2 triangle 







311 top right 


333 


P 3 


3,3,3 turnover 







311 middle left 


*333 


p3ml 


3,3,3 triangle 







311 middle right 


3*3 


p31m 


6,3,2 turnover, slit along 3,2 





311 bottom left 


632 


P 6 


6,3,2 turnover 







311 bottom right 


*632 


p6m 


6,3,2 triangle 








The gures on pages 309-31 1 show wallpaper patterns based on each of the 17 
types of crystallographic groups (two patterns are shown for the °, or translations- 
only, type). Thin lines bound unit cells, or fundamental domains. When solid, they 
represent lines of mirror symmetry, and are fully determined. When dashed, they 
represent arbitrary boundaries, which can be shifted so as to give different funda- 
mental domains. One can even make these lines into curves, provided the symmetry 
is respected. Dots at the intersections of thin lines represent centers of rotational 
symmetry. 

Some of the relationships between the types are made obvious by the patterns. 
For instance, on the rst row of page 309, we see that the group on the right, of type 
xx , contains the one on the left, of type °, with index two. However, there are more 
relationships than can be indicated in a single set of pictures. For instance, there is a 
group of type xx hiding in any group of type 3*3. 
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4.2.5 CLASSIFYING THE CRYSTALLOGRAPHIC GROUPS 



To classify an image representing a crystallographic group, answer the following 
sequence of questions starting with: "What is the minimal rotational invariance?". 



None 

Is there a re ection? 

- No. 

Is there a glide-re ection? 

* No: pi (page 309) 

* Yes: pg (page 309) 

- Yes. 

Is there a glide-re ection in 
an axis that is not a re ection 

axis? 

* No: pm (page 309) 

* Yes: cm (page 309) 

2-fold (180° rotation) 
Is there a re ection? 

- No. 

Is there a glide-re ection? 

* No: p2 (page 310) 

* Yes: pgg (page 309) 

- Yes. 

Are there re ections in two di- 
rections? 

* No: pmg (page 309) 

* Yes: Are all rotation cen- 
ters on re ection axes? 

• No: cmm (page 310) 

• Yes: pmm (page 310) 



3- fold (120° rotation) 
Is there a re ection ? 

- No: p3 (page 311) 

- Yes. 

Are all centers of threefold ro- 
tations on re ection axes? 

* No: p31m (page 31 1) 

* Yes: p3ml (page 311) 

4- fold (90° rotation) 
Is there a re ection ? 

- No: p4 (page 310) 

- Yes. 

Are there four re ection axes? 

* No: p4g (page 310) 

* Yes: p4m (page 310) 

6-fold (60° rotation) 
Is there a re ection ? 

- No: p6 (page 311) 

- Yes: p6m (page 311) 



4.3 OTHER TRANSFORMATIONS OF THE PLANE 



4.3.1 SIMILARITIES 

A transformation of the plane that preserves shapes is called a similarity. Every sim- 
ilarity of the plane is obtained by composing a proportional scaling transformation 
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(also known as a homothety) with an isometry. A proportional scaling transformation 
centered at the origin has the form 



(x,y) i ^ (ax, ay), 



(4.3.1) 



where a ^ is the scaling factor (a real number). The corresponding matrix in 
homogeneous coordinates is 



a 
a 
1 



(4.3.2) 



In polar coordinates, the transformation is (r, 6) h-> (ar, #) . 



4.3.2 AFFINE TRANSFORMATIONS 

A transformation that preserves lines and parallelism (maps parallel lines to parallel 
lines) is an afne transformation. There are two important particular cases of such 
transformations: 

A non-proportional scaling transformation centered at the origin has the form 

(x, y) h-> (ax, by), where a, b ^ are the scaling factors (real numbers). The 

corresponding matrix in homogeneous coordinates is 



H a ,b 



a 
6 
1 



(4.3.3) 



A shear preserving horizontal lines has the form (x,y) h-> (x + ry,y), where r 
is the shearing factor (see Figure 4.6). The corresponding matrix in homogeneous 
coordinates is 

"1 r 0" 

S r = 1 . (4.3.4) 
1 

Every af ne transformation is obtained by composing a scaling transformation with 
an isometry, or a shear with a homothety and an isometry. 



FIGURE 4.6 

A shear with factor r = |. 
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FIGURE 4.7 

A perspective transformation with center O, mapping the plane P to the plane Q. The trans- 
formation is not de n ed on the line L, where P intersects the plane parallel to Q and going 
through O. 




4.3.3 PROJECTIVE TRANSFORMATIONS 

A transformation that maps lines to lines (but does not necessarily preserve paral- 
lelism) is a projective transformation. Any plane projective transformation can be 
expressed by an invertible 3x3 matrix in homogeneous coordinates; conversely, 
any invertible 3x3 matrix de nes a projective transformation of the plane. Projec- 
tive transformations (if not af ne) are not de ned on all of the plane but only on the 
complement of a line (the missing line is "mapped to in nity"). 

A common example of a projective transformation is given by a perspective 
transformation (Figure 4.7). Strictly speaking this gives a transformation from one 
plane to another, but, if we identify the two planes by (for example) xing a Cartesian 
system in each, we get a projective transformation from the plane to itself. 



4.4 LINES 

The (Cartesian) equation of a straight line is linear in the coordinates x and y: 

ax + by + c = 0. (4.4.1) 

The slope of this line is —a/b, the intersection with the x-axis (or x-intercept) is 
x = —c/a, and the intersection with the y-axis (or y-intercept) is y = —c/b. If 
a = 0, the line is parallel to the x-axis, and if b = 0, then the line is parallel to the 
y-axis. 
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(In an oblique coordinate system, everything in the preceding paragraph remains 
true, except for the value of the slope.) 

When a 2 + b 2 = 1 and c < in the equation ax + by + c = 0, the equation 
is said to be in normal form. In this case — c is the distance of the line to the origin, 
and u (with cos cj = a and sin cj = b) is the angle that the perpendicular dropped to 
the line from the origin makes with the positive a;-axis (Figure 4.8, with p = —c). 

To reduce an arbitrary equation ax + by + c = to normal form, divide by 
±\/a 2 + b 2 , where the sign of the radical is chosen opposite the sign of c when 
c ^ and the same as the sign of b when c = 0. 



FIGURE 4.8 

The normal form of the line L is x cos w + y sin u> = p. 




4.4.1 LINES WITH PRESCRIBED PROPERTIES 

1. Line of slope m intersecting the a;-axis at x = xo- y = m(x — xo)- 

2. Line of slope m intersecting the y-axis at y = y : y = rax + yo- 

3. Line intersecting the a;-axis at x = xo and the y-axis at y = y : 

1. 



x y 
— + — 

xo yo 



(This formula remains true in oblique coordinates.) 

4. Line of slope m passing though (xq, yo)'- V — Vo = m(x — xo). 

5. Line passing through points (xo,yo) and {x\ , yf): 



2/ - 2/i 



2/o - 2/i 



or 



x y 1 
xo 2/o 1 
x\ yi 1 



X — X\ Xo — X\ 

(These formulae remain true in oblique coordinates?) 



0. 



6. Slope of line going through points (xq, yo) an d (xi ,yi): 



2/i ~ 2/Q 
x\ - xo ' 



(4.4.2) 



(4.4.3) 
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7. Line passing through points with polar coordinates (ro,&o) and (n , 6\): 

r(r sin(6> - O ) - n sin(6> - Qy)) = r n sin(6»i - 9 ). (4.4.4) 



4.4.2 DISTANCES 



The distance between two points in the plane is the length of the line segment joining 
the two points. If the points have Cartesian coordinates (xo,yo) and (xi,yi), this 

distance is 

y/( Xl -x y + ( yi -y y. (4.4.5) 

If the points have polar coordinates (ro, #o) an d ( r i j this distance is 



hi +rf- 2r ori cos(6» - 9i). (4.4.6) 
If the points have oblique coordinates (xo,yo) an d (xi , yi), this distance is 

Vfci -^o) 2 + (2/1 -yo) 2 +2(xi -x )(2/i -y )coscj, (4.4.7) 

where cj is the angle between the axes (Figure 4.5). 

The point k% of the way from P = (xo,yo) to Pi = (x\ ,y{) is 



<kxi + (100 - fc)a; fcj/i + (100 - %o ' 



100 



100 



(4.4.8) 



(The same formula also works in oblique coordinates.) This point divides the seg- 
ment PqPi in the ratio k : (100 — k). As a particular case, the midpoint of PqP\ is 
given by [\{x +x 1 ), \(yo+y\)) ■ 

The distance from the point (xq, yo) to the line ax + by + c = is 



aa; + by + c 
Va 2 + 6 2 



(4.4.9) 



4.4.3 ANGLES 

The a«g/e between two lines ciqx + boy + Co = and a\x + b\y + c\ = is 

tan -i h. _ tan -i 60 = tan -i "oh-mbo 

a\ ao a^ai + O0&1 

In particular, the two lines are parallel when a^bi = a\b(,, and perpendicular when 
float = -6061. 

The angle between two lines of slopes mo and mi is tan -1 (mi) — tan -1 (mo) 
(or tan -1 ((mi — mo) /(l + momi))). In particular, the two lines are parallel when 
mo = mi and perpendicular when momi = —1. 
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4.4.4 CONCURRENCE AND COLLINEARITY 



Three lines ciqx + boy + cq = 0, a\x + b\y + c\ = 0, and 022; + biy + 02 
concurrent (i.e., intersect at a single point) if and only if 

a b c 
a\ b\ c\ = 0. 

a-i bi c-i 

(This remains true in oblique coordinates^) 

Three points (xo,yo), (xi,yi), and (^2,2/2) are collinear (i.e., all three points 
are on a straight line) if and only if 



are 



(4.4.11) 



xo yo 1 
xi yi 1 
X2 yi 1 



= 0. 



(4.4.12) 



(This remains true in oblique coordinates?) 

; .. ;>i, „ 1 coordinates (ro,#o)> {ri,0\), and ^2,^2) are collinear 



Three points with polar 
if and only if 



nr 2 sin(#2 - 0i) + r n sin(6>i - 6 ) + r 2 r sm(6 - 2 ) = 0. (4.4.13) 



4.5 POLYGONS 

Given k > 3 points A\, . . . , Af. in the plane, in a certain order, we obtain a k-sided 
polygon or fc-gow by connecting each point to the next, and the last to the rst, with a 
line segment. The points Ai are the vertices and the segments AiAi + i are the sides 
or edges of the polygon. When k = 3 we have a triangle, when A; = 4 we have a 
quadrangle or quadrilateral, and so on (see page 324 for names of regular polygons). 
Here we will assume that all polygons are simple: this means that no consecutive 
edges are on the same line and no two edges intersect (except that consecutive edges 
intersect at the common vertex) (see Figure 4.9). 



FIGURE 4.9 

Two simple quadrilaterals (left and middle) and one that is not simple (right). We will treat 
only simple polygons. 



.4, 
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When we refer to the angle at a vertex A k we have in mind the interior angle 
(as marked in the leftmost polygon in Figure 4.9). We denote this angle by the same 
symbol as the vertex. The complement of A k is the exterior angle at that vertex; 
geometrically, it is the angle between one side and the extension of the adjacent side. 
In any k-gon, the sum of the angles equals 2 {k — 2) right angles, or 2(k — 2) x 90 °; 
for example, the sum of the angles of a triangle is 180°. 

The area of a polygon whose vertices Ai have coordinates (xi,yi), for 1 < i < 
k, is the absolute value of 

area = |(a;ij/2 - x 2 yi) H h \{x k -iy k - x k y k -i) + \{x k y x - xiy k ), 

1 * , (4-5.1) 

i=l 

where in the summation we take x k +i = x\ and y k +i = y\. In particular, for a 
triangle we have 



1/ \ 1 

area= %{xiy 2 - x 2 yi + x 2 y 3 -x 3 y 2 + x 3 yi -Xiy 3 ) = - 



x\ yi 1 
x 2 y 2 1 
x 3 y 3 1 



(4.5.2) 



In oblique coordinates with angle uj between the axes, the area is as given above, 
multiplied by sin ui. 

If the vertices have polar coordinates (r,,^,), for 1 < i < k, the area is the 
absolute value of 

1 * 

area = 2 r * r *+! sin (^+i ~ (4.5.3) 

i-l 

where we take r k +i = r\ and 8 k +i = 9\. 

Formulae for speci c polygons in terms of side lengths, angles, etc., are given 
on the following pages. 



4.5.1 TRIANGLES 

Because the angles of a triangle add up to 180°, at least two of them must be acute 
(less than 90°). In an acute triangle all angles are acute. A right triangle has one 
right angle, and an obtuse triangle has one obtuse angle. 

The altitude corresponding to a side is the perpendicular dropped to the line 
containing that side from the opposite vertex. The bisector of a vertex is the line 
that divides the angle at that vertex into two equal parts. The median is the segment 
joining a vertex to the midpoint of the opposite side. See Figure 4.10. 

Every triangle also has an inscribed circle tangent to its sides and interior to 
the triangle (in other words, any three non-concurrent lines determine a circle). The 
center of this circle is the point of intersection of the bisectors. We denote the radius 
of the inscribed circle by r. 

Every triangle has a circumscribed circle going through its vertices; in other 
words, any three non-collinear points determine a circle. The point of intersection of 
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FIGURE 4.10 

Notations for an arbitrary triangle of sides a, b, c and vertices A, B, C. The altitude cor- 
responding to C is h c , the median is m c , the bisector is t c - The radius of the circumscribed 
circle is R, that of the inscribed circle is r. 




the medians is the center of mass of the triangle (considered as an area in the plane). 
We denote the radius of the circumscribed circle by R. 

Introduce the following notations for an arbitrary triangle of vertices A, B, C 
and sides a, b, c (see Figure 4.10). Let h c , t c , and m c be the lengths of the altitude, 
bisector, and median originating in vertex C, let r and R be as usual the radii of the 
inscribed and circumscribed circles, and let s be the semi-perimeter: s = ^(a+b+c). 
Then 

A + B + C = 180° 

c 2 = a 2 + b 2 — 2abcosC (law of cosines), 
a = b cos C + c cos B, 

a b c n t ■ ^ 

(law of sines), 



sin A sin B sin C 

, , , . c 2 sin A sin B abc 

area = 7rh c c = ^ab smG = — = rs = , 

2 2 2sinC AR 



\/s(s — a)(s — b)(s — c) {Heron) 

ab sin C 
~2s 



csin(i^) sin(|B) sec(iC) = — = (s - c) tan(iC), 



(— + — + —Y 1 

\h a h b hj 



R 



abc 



2 sin C 4 area ' 

2 area 



h r = a sin B = b sin A 
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2ab x 

cos 

a + b 2 




(a + by 



and 



A triangle is equilateral if all of its sides have the same length, or, equivalently, 
if all of its angles are the same (and equal to 60°). It is isosceles if two sides are the 
same, or, equivalently, if two angles are the same. Otherwise it is scalene. 

For an equilateral triangle of side a we have 



area : 



|aV3, R = |a\/3, 



h 



ia\/3, 



(4.5.4) 



where h is any altitude. The altitude, the bisector, and the median for each vertex 
coincide. 

For an isosceles triangle, the altitude for the uonequal side is also the corre- 
sponding bisector and median, but this is not true for the other two altitudes. Many 
formulae for an isosceles triangle of sides a, a, c can be immediately derived from 
those for a right triangle of legs a, \c (see Figure 4.1 1, left). 

For a right triangle, the hypotenuse is the longest side and is opposite the right 
angle; the legs are the two shorter sides adjacent to the right angle. The altitude for 
each leg equals the other leg. In Figure 4.11 (right), h denotes the altitude for the 
hypotenuse, while m and n denote the segments into which this altitude divides the 
hypotenuse. 

The following formulae apply for a right triangle: 



A + B = 

r = 


90°, 
ab 

a + b + c 


c 2 
R 


= a 2 + b 2 
= ±c 

2 ' 


(Pythagoras), 


a = 


csin A = ccosB, 


b 


= c sin B = 


ccosA, 


mc = 


b\ 


nc 


= a\ 




area = 


\ab, 


he 


= ab. 





FIGURE 4.11 

Left: an isosceles triangle can be divided into two congruent right triangles. Right: notations 
for a right triangle. 
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FIGURE 4.12 

Left: Ceva 's theorem. Right: Menelaus 's theorem. 




The hypotenuse is a diameter of the circumscribed circle. The median joining 
the midpoint of the hypotenuse (the center of the circumscribed circle) to the right 
angle makes angles 2A and 2B with the hypotenuse. 

Additional facts about triangles: 

1 . In any triangle, the longest side is opposite the largest angle, and the shortest 
side is opposite the smallest angle. This follows from the law of sines. 

2. Ceva's theorem (see Figure 4.12, left): In a triangle ABC, let D, E, and F 
be points on the lines BC, CA, and AB, respectively. Then the lines AD, 
BE, and CF are concurrent if, and only if, the signed distances BD, CE, . . . 
satisfy 

BD -CE ■ AF = DC ■ EA- FB. (4.5.5) 

This is so in three important particular cases: when the three lines are the 
medians, when they are the bisectors, and when they are the altitudes. 

3. Menelaus's theorem (see Figure 4.12, right): In a triangle ABC, let D, E, and 
F be points on the lines BC, CA, and AB, respectively. Then D, E, and F 
are collinear if, and only if, the signed distances BD, CE, . . . satisfy 

BD CE ■ AF = -DC ■ EA ■ FB. (4.5.6) 

4. Each side of a triangle is less than the sum of the other two. For any three 
lengths such that each is less than the sum of the other two, there is a triangle 
with these side lengths. 

5. Determining if a point is inside a triangle 

Given a triangle's vertices {Po, P\, P2} and the test point P 3 , place P at the 
origin by subtracting its coordinates from each of the others. Then compute 
(here = (xi,yi)) 

a = xiy 2 - x 2 yi, 

b = x 1 y 3 -x 3 y 1 , (4.5.7) 
c = x 2 y 3 - x 3 y 2 
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The point P 3 is inside the triangle {P , Pi , P 2 } if and only if 

ab > and ac < and a(a - b + c) > (4.5.8) 



4.5.2 QUADRILATERALS 

The following formulae give the area of a general quadrilateral (see Figure 4.13, 
left, for the notation). 

area = \pqsm6 = \(b 2 + d 2 — a 2 — c 2 ) tan# 

= \\/<±p 2 q 2 - (b 2 + d 2 - a 2 - c 2 ) 2 (4.5.9) 

= \J (s — a)(s — b)(s — c)(s — d) — abcdcos \(A + C). 



FIGURE 4.13 

Left: notation for a general quadrilateral; in addition s = \(a + b + c + d). Right: a 
parallelogram. 




Often, however, it is easiest to compute the area by dividing the quadrilateral into 
triangles. One can also divide the quadrilateral into triangles to compute one side 
given the other sides and angles, etc. 

More formulae can be given for special cases of quadrilaterals. In a parallel- 
ogram, opposite sides are parallel and the diagonals intersect in the middle (Fig- 
ure 4.13, right). It follows that opposite sides have the same length and that two 
consecutive angles add up to 180°. In the notation of the gure, we have 

A = C, B = D, A + 5 = 180°, 

h = asm A = a sin I? , area = bh, 

p = \j a 2 +b 2 — 2ab cos A, q = \j a 2 +b 2 — 2ab cos B. 

(All this follows from the triangle formulae applied to the triangles ABD and ABC.) 
Two particular cases of parallelograms are 

1. The rectangle where all angles equal 90°. The diagonals of a rectangle 
have the same length. The general formulae for parallelograms reduce to 

h = a, area = ab, and p = q = \J a 2 + b 2 , (4.5.10) 
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2. The rhombus or diamond <0> , where adjacent sides have the same length (a = 
b). The diagonals of a rhombus are perpendicular. In addition to the general 
formulae for parallelograms, we have area = \pq and p 2 + q 2 = 4a 2 . 

The square or regular quadrilateral is both a rectangle and a rhombus. 

A quadrilateral is a trapezoid if two sides are parallel. D C 

In the notation of the gure on the right we have 

A + D = B + C = 180°, area = \(AB + CD)h. 

AH 

The diagonals of a quadrilateral with consecutive sides a, b, c, d are perpendic- 
ular if and only if a 2 + c 2 =b 2 + d 2 . 

A quadrilateral is cyclic if it can be inscribed in a circle, that is, if its four vertices 
belong to a single, circumscribed, circle. This is possible if and only if the sum of 
opposite angles is 180°. If R is the radius of the circumscribed circle, we have (in 
the notation of Figure 4.13, left) 




i 

hi 
i 



area : 



\j (s — a)(s — b)(s — c)(s — d) = \(ac + bd) sin#, 

a/ (ac + bd)(ad + bc)(ab + cd) 

(Brahmagupta), 



1 {ac + bd)(ab + cd) 
(ad + be) 



R 



sin 8 



(ac + bd)(ad + bc)(ab + cd) 
(s — a)(s — b)(s — c)(s — d)' 
2 area 



ac + bd 
pq = ac + bd (Ptolemy). 

A quadrilateral is circumscribable if it has an inscribed circle (that is, a circle 
tangent to all four sides). Its area is rs, where r is the radius of the inscribed circle 
and s is as above. 

For a quadrilateral that is both cyclic and circumscribable, we have the following 
additional equalities, where m is the distance between the centers of the inscribed 
and circumscribed circles: 



a -\- c = b + d, area = V abed ■ 



rs, 



1 (ac + bd)(ad + bc)(ab + cd) 1 1 
R = tA/ ; — ; . = 7"^ ^ + 



4 V abed ' r 2 (R-m) 2 (R + m) 2 



4.5.3 REGULAR POLYGONS 

A polygon is regular if all its sides are equal and all its angles are equal. Either 
condition implies the other in the case of a triangle, but not in general. (A rhombus 
has equal sides but not necessarily equal angles, and a rectangle has equal angles but 
not necessarily equal sides.) 
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For a fc-sided regular polygon of side a, let 8 be the angle at any vertex, and r 
and R the radii of the inscribed and circumscribed circles (r is called the apothem). 
As usual, let s = \ka be the half-perimeter. Then 

" k ~ r ' 180° 



area 



R 



k 



a = 2r tan ■ 



180° 



k 



2R sin ■ 



180° 



k 



i, 2 !80° 
jka cot — — 

* k 

i , „ 2 • 360 ° 
TjkR sin — - — , 

z k 



kr tan 



180° 



a cot 



a esc ■ 



180° 

~k~' 
1 80° 

IT' 




Name 


k 


area 


r 


R 


Equilateral triangle 


3 


0.43301a 2 


0.28868 a 


0.57735 a 


Square 


4 


a 2 


0.50000 a 


0.70711a 


Regular pentagon 


5 


1.72048 a 2 


0.68819 a 


0.85065 a 


Regular hexagon 


6 


2.59808 a 2 


0.86603 a 


a 


Regular heptagon 


7 


3.63391a 2 


1.03826 a 


1.15238 a 


Regular octagon 


8 


4.82843 a 2 


1.20711a 


1.30656 a 


Regular nonagon 


9 


6.18182a 2 


1.37374 a 


1.46190 a 


Regular decagon 


10 


7.69421a 2 


1.53884 a 


1.61803 a 


Regular undecagon 


11 


9.36564 a 2 


1.70284 a 


1.77473 a 


Regular dodecagon 


12 


11.19625 a 2 


1.86603 a 


1.93185 a 



If cik denotes the side of a A;-sided regular polygon inscribed in a circle of radius 
R, we have 



d2k 



2R 2 — R\/4R 2 — a\. 



(4.5.11) 



If Af. denotes the side of a A;-sided regular polygon circumscribed about the same 
circle, 

, 2RA k 



In particular, 



A 



2k 



2R + v^i? 2 + I 2 

a>kAk 



Cl2k 



a-k + A k V 2 

The areas s k , S2k, S k , and S^k of the same polygons satisfy 

s 2k + Sk 



S2k — V SkSk, S-2k 



(4.5.12) 



(4.5.13) 



(4.5.14) 
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4.6 CONICS 



A conic (or conic section) is a plane curve that can be obtained by intersecting a right 
circular cone (page 361) with a plane that does not go through the vertex of the cone. 
There are three possibilities, depending on the relative positions of the cone and the 
plane (Figure 4.14). If no line of the cone is parallel to the plane, then the intersection 
is a closed curve, called an ellipse. If one line of the cone is parallel to the plane, 
the intersection is an open curve whose two ends are asymptotically parallel; this is 
called a parabola. Finally, there may be two lines in the cone parallel to the plane; 
the curve in this case has two open segments, and is called a hyperbola. 



FIGURE 4.14 

A section of a cone by a plane can yield an ellipse (left), a parabola (middle) or a hyperbola 
(right). 




4.6.1 ALTERNATIVE CHARACTERIZATION 

Assume given a point F in the plane, a line d not going through F, and a positive 
real number e. The set of points P such that the distance PF is e times the distance 
from P to d (measured along a perpendicular) is a conic. We call F the focus, d the 
directrix, and e the eccentricity of the conic. If e < 1 we have an ellipse, if e = 1 a 
parabola, and if e > 1 a hyperbola (Figure 4.15). This construction gives all conies 
except the circle, which is a particular case of the ellipse according to the earlier 
de nition (we can recover it by taking the limit e — > 0). 

For any conic, a line perpendicular to d and passing through F is an axis of 
symmetry. The ellipse and the hyperbola have an additional axis of symmetry, per- 
pendicular to the rst, so that there is an alternate focus and directrix, F' and d! , 
obtained as the re ection of F and d with respect to this axis. (By contrast, the focus 
and directrix are uniquely de ned for a parabola.) 

The simplest analytic form for the ellipse and hyperbola is obtained when the 
two symmetry axes coincide with the coordinate axes. The ellipse in Figure 4.16 has 
equation 

i i 

— + Ij = 1, (4.6.1) 
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FIGURE 4.15 

De nition of conies by means of the ratio ( eccentricity ) between the distance to a point and 
the distance to a line. On the left, e = .7 (ellipse); in the middle, e = 1 (parabola); on the 
right, e = 2 (hyperbola). 




with b < a. The x-axis is the major axis, and the y-axis is the minor axis. These 
names are also applied to the segments, determined on the axes by the ellipse, and 
to the lengths of these segments: 2a for the major axis and 2b for the minor. The 
vertices are the intersections of the major axis with the ellipse and have coordinates 
(a, 0) and (—a, 0). The distance from the center to either focus is \/a 2 — b 2 , and the 
sum of the distances from a point in the ellipse to the foci is 2a. The latera recta 
(in the singular, latus rectum) are the chords perpendicular to the major axis and 
going through the foci; their length is 2b 2 /a. The eccentricity is \J a 2 — b 2 /a. All 
ellipses of the same eccentricity are similar; in other words, the shape of an ellipse 
depends only on the ratio b/a. The distance from the center to either directrix is 
a 2 /Va 2 -b 2 . 

The hyperbola in Figure 4.17 has equation 

4 - fj = I- (4.6.2) 

cr b 2 
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FIGURE 4.17 

Hyperbola with transverse semiaxis a and conjugate semiaxis b. Here b/a = 0.4. 




The a;-axis is the transverse axis, and the y-axis is the conjugate axis. The 
vertices are the intersections of the transverse axis with the hyperbola and have co- 
ordinates (a, 0) and (—a, 0). The segment thus determined, or its length 2a, is also 
called the transverse axis, while the length 2b is also called the conjugate axis. The 
distance from the center to either focus is \/a' 2 + b 2 , and the difference between the 
distances from a point in the hyperbola to the foci is 2a. The latera recta are the 
chords perpendicular to the transverse axis and going through the foci; their length 
is 2b 2 /a. The eccentricity is V 'a 2 +b 2 /a. The distance from the center to either 
directrix is a 2 j\Jd 2 + b 2 . The legs of the hyperbola approach the asymptotes, lines 
of slope ±b/a that cross at the center. 

All hyperbolas of the same eccentricity are similar; in other words, the shape 
of a hyperbola depends only on the ratio b/a. Unlike the case of the ellipse (where 
the major axis, containing the foci, is always longer than the minor axis), the two 
axes of a hyperbola can have arbitrary lengths. When they have the same length, so 
that a = b, the asymptotes are perpendicular, and e = \/2, the hyperbola is called 
rectangular. 

The simplest analytic form for the parabola is obtained 
when the axis of symmetry coincides with one coordinate 
axis, and the vertex (the intersection of the axis with the 
curve) is at the origin. The equation of the parabola on the 
right is 

y 2 = Aax, (4.6.3) 

where a is the distance from the vertex to the focus, or, which 
is the same, from the vertex to the directrix. The latus rectum 
is the chord perpendicular to the axis and going through the 
focus; its length is 4a. All parabolas are similar: they can be 
made identical by scaling, translation, and rotation. 
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4.6.2 THE GENERAL QUADRATIC EQUATION 



The analytic equation for a conic in arbitrary position is the following: 



Ax 2 + By 2 + Cxy + Dx + Ey + F = 



(4.6.4) 



where at least one of A, B, C is nonzero. To reduce this to one of the forms given 
previously, perform the following steps (note that the decisions are based on the most 
recent values of the coef cients, taken after all the transformations so far): 

1. If C ^ 0, simultaneously perform the substitutions x h-> qx + y and y i->- 
qy — x, where 



Now C = 0. (This step corresponds to rotating and scaling about the origin.) 

2. If B = 0, interchange x and y. Now B ^ 0. 

3. If E ^ 0, perform the substitution y i->- y — ^(E/B). (This corresponds to 
translating in the y direction.) Now E = 0. 

4. If A = 0: 

(a) If D ^ 0, perform the substitution x i y x (F/D) (translation in the 
x direction), and divide the equation by B to get Equation (4.6.3). The 
conic is a parabola. 

(b) If D = 0, the equation gives a degenerate conic. If F = 0, we have the 
line y = with multiplicity two. If F < 0, we have two parallel lines 
y = ±y?F/B. If F > we have two imaginary lines; the equation has 
no solution within the real numbers. 

5. If A ^ 0: 

(a) If D ^ 0, perform the substitution x h-> x - \{D/A). Now D = 0. 
(This corresponds to translating in the x direction.) 

(b) If F ^ 0, divide the equation by F to get a form with F = 1. 



iii. If A and B are both negative, we have an imaginary ellipse; the 
equation has no solution in real numbers. 




(4.6.5) 



i. If A and B have opposite signs, the conic is a hyperbola; to get 
to Equation (4.6.2), interchange x and y, if necessary, so that A is 
positive; then make a = 1/ v^4 and 6 = 1/ i/B. 



ii. If A and B are both positive, the conic is an ellipse; to get to Equa- 
tion (4.6.1), interchange x and y, if necessary, so that A < B, then 
make a = 1/ v^4 and 6 = 1/ i/B- The drde is the particular case 
a = 6. 
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(c) If F = 0, the equation again represents a degenerate conic: when A and 
B have different signs, we have a pair of lines y = ± ^J—B/Ax, and, 
when they have the same sign, we get a point (the origin). 



EXAMPLE We work out an example for clarity. Suppose the original equation is 



Ax +y - Axy + 3x - Ay + 1 = 0. 



(4.6.6) 



In step 1 we apply the substitutions x h-> 2x + y and y ^ 2y — x. This gives 
25x 2 + lOx — 5y + 1 = 0. Next we interchange x and y (step 2) and get 25y 2 + 
Wy — 5x + 1 = 0. Replacing ybyy — ^in step 3, we get 25?/ 2 — 5x = 0. Finally, in 
step 4a we divide the equation by 25, thus giving it the form of Equation (4.6.3) with 
a = . We have reduced the conic to a parabola with vertex at the origin and focus 
at (i, 0). To locate the features of the original curve, we work our way back along 
the chain of substitutions (recall the convention about substitutions and transformations 
from Section 4.1.2): 



Substitution 
Vertex (0, 0) 
Focus 



y^y 



yt-+2y- 



(o,- 
(— ■ 

V 20 ' 



) (- 



5 ' 20' 



2 
" 5 5 



( 5 ' 5 > 

(-— — ) 

y 20 ' 20' 



We conclude that the original curve, Equation (4.6.6), is a parabola with vertex 
(-f >-f) and focus (-^,^). 
An alternative analysis of Equation (4.6.4) consists in forming the quantities 



K 



\C 



B \E 
\E F 



J 



A \C 
hC B 



I = A + B, 



(4.6.7) 





B \E 


+ 


\E F 



and nding the appropriate case in the following table, where an entry in parentheses 
indicates that the equation has no solution in real numbers: 



A 


J 


A/I 


K 


Type of conic 


^0 


< 






Hyperbola 











Parabola 


7^0 


> 


< 




Ellipse 


7^0 


> 


> 




(Imaginary ellipse) 





< 






Intersecting lines 





> 






Point 










< 


Distinct parallel lines 










> 


(Imaginary parallel lines) 













Coincident lines 



For the central conies (the ellipse, the hyperbola, intersecting lines, and the point), 
the center (xo, yo) is the solution of the system of equations 



2Ax + Cy + D 
Cx + 2By + E 



0, 
0, 
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namely 



( 2BD - CE 2AE-CD 



V C 2 - AAB ' C 2 - 4,45 



(4.6.8) 



and the axes have slopes q and —1/q, where q is given by Equation (4.6.5). (The 
value — 1/q can be obtained from Equation (4.6.5) by simply placing a minus sign 
before the radical.) The length of the semiaxis with slope q is 




j . , where r = \{A + B + ^/ (B - A) 2 + C 2 ); 
Jr\ 2 



(4.6.9) 



note that r is one of the eigenvalues of the matrix of which J is the determinant. To 
obtain the other semiaxis, take the other eigenvalue (change the sign of the radical in 
the expression of r just given). 

EXAMPLE Consider the equation 3a; 2 + 4xy - 2y 2 + 3x - 2y + 7 = 0. We have 



6 4 
4 -4 

3 -2 

6 4 

4 -4 



3 

-2 

14 



-596 ^ 



-40 < 



We conclude that this is a hyperbola. 



4.6.3 ADDITIONAL PROPERTIES OF ELLIPSES 

1, with a > b, and let F, F 1 



Let C be the ellipse with equation x 2 /a 2 + y 2 /b 2 
(±-\/a 2 — b 2 , 0) be its foci (see Figure 4. 16). 

1. A parametric representation for C is 
given by (acos#, 6sin#). The area of 
the shaded sector on the right is ^ab8 = 
hab cos -1 (x/a). The length of the arc 
from (a, 0) to the point (a cos 9, 6sin#) 
is given by the elliptic integral 




(acosO, 6sin#) = (x,y) 



a { E {\' e )~ E {\~ e ' e ))' (4 ' 6 - 10) 



where e is the eccentricity. (See page 569 for elliptic integrals.) Setting 6 = 2ir 
results in 

area of C = nab, perimeter of C = 4aE(Tr/2,e). (4.6.11) 
Note the approximation: perimeter of C fa 2a [2 + (tt — 2) (| ) 1 ' 456 j . 
2. Given an ellipse in the form ^4a; 2 + By 2 + Cxy = 1, form the matrix D = 

AC /2 1 

7 1 . Let the eigenvalues of D be {Ai , A2} and let {vi , V2} be the cor- 



[C/2 B 

responding unit eigenvectors (choose them orthogonal if A 1 
major and minor semi-axes are given by v,: = -^j= and 



A2). Then the 
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(a) The area of the ellipse is , = = = 

VMM s/4AB - C 2 

(b) The ellipse has the parametric representation x(t) = cos(£)vi +sin(t)v2- 

(c) The rectangle with vertices (±Vi, ±Va) is tangent to the ellipse. 

3. A rational parametric representation for C is given by - — ^ , - — ^ j . 

4. The polar equation for C in the usual polar coordinate system is 

Ub (4.6.12) 



a/ a 2 sin 2 8 + b 2 cos 2 
With respect to a coordinate system with origin at a focus, the equation is 

I 



1 ± ecos#' 



(4.6.13) 



where I = b 2 /a is half the latus rectum. (Use the + sign for the focus with 
positive ^-coordinate and the — sign for the focus with negative ^-coordinate.) 

5. Let P be any point of C. The sum of the distances PF and PF 1 is constant 
and equal to 2a. 

6. Let P be any point of C. Then the rays PF and PF ' make the same angle 
with the tangent to C at P. Thus any light ray originating at F and re ected 
in the ellipse will go through F' . 

7. Let T be any line tangent to C. The product of the distances from F and F ' to 
T is constant and equals b 2 . 

8. Lahire's theorem: Let D and D' be x ed lines in the plane, and consider a 
third moving line on which three points P, P', and P" are marked. If we 
constrain P to lie in D and P' to lie in D', then P" describes an ellipse. 



4.6.4 ADDITIONAL PROPERTIES OF HYPERBOLAS 

Let C be the hyperbola with equation x 2 /a 2 — y 2 jb 2 = 1, and let 

F, F' = (±vV +b 2 , 0) (4.6.14) 

be its foci (see Figure 4. 17). The conjugate hyperbola of C is the hyperbola C 1 with 
equation — x 2 /a 2 + y 2 /b 2 = 1. It has the same asymptotes as C, the same axes 
(transverse and conjugate axes being interchanged), and its eccentricity e ' is related 
to that of C by e'" 2 + e" 2 = 1. 
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1. A parametric representation for C is given 
by (asecO, 6tan#). A different paramet- 
ric representation, which gives one branch 
only, is (a cosh 9, 6sinh#). The area of the 
shaded sector on the right is 

\ab9 = \ ab cosh - 1 (x/ a) 



\ab log ; 



+ V 'x 2 — a 2 




(a cosh 0, 6sinh( 



where x = a cosh#. The length of the arc from the point (a, 0) to the point 
(a cosh 9, b sinh 9) is given by the elliptic integral 



■ J yje 2 cosh 2 <j) - 1 dcj) = -biE(6i, = a J 



x / e 2C2 



e 2 ^ 2 — a 2 

e - a 2 



where e is the eccentricity and i = 
2. A rational parametric representation for C is given by 

1 + 1 2 2bt 



/ i + r zot \ 



3. The polar equation for C in the usual polar coordinate system is 



(4.6.15) 



(4.6.16) 



\J a 2 sin 2 9 — b 2 cos 2 9 
With respect to a system with origin at a focus, the equation is 



(4.6.17) 



1 ± ecos#' 



(4.6.18) 



where I = b 2 /a is half the latus rectum. (Use the — sign for the focus with 
positive x-coordinate and the + sign for the focus with negative ^-coordinate.) 

4. Let P be any point of C. The unsigned difference between the distances PF 
and PF 1 is constant and equal to 2a. 

5. Let P be any point of C. Then the rays PF and PF 1 make the same angle 
with the tangent to C at P. Thus any light ray originating at F and re ected 
in the hyperbola will appear to emanate from F'. 

6. Let T be any line tangent to C. The product of the distances from F and F 1 to 
T is constant and equals b 2 . 

7. Let P be any point of C . The area of the parallelogram formed by the asymp- 
totes and the parallels to the asymptotes going through P is constant and equals 
hab. 
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8. Let L be any line in the plane. If L intersects C at P and P' and intersects 
the asymptotes at Q and Q 1 , the distances PQ and P'Q' are the same. If L 
is tangent to C we have P = P', so that the point of tangency bisects the 
segment QQ'. 



4.6.5 ADDITIONAL PROPERTIES OF PARABOLAS 

Let C be the parabola with equation y 2 = Aax, and let F = (a, 0) be its focus. 

1. Let P = (x,y) and P' = (x',y') be points on C. The area bounded by the 
chord PP' and the corresponding arc of the parabola is 

|y '" y|3 (4.6.19) 



24a 

It equals four-thirds of the area of the triangle PQP', where Q is the point on 
C whose tangent is parallel to the chord PP 1 (formula due to Archimedes). 

2. The length of the arc from (0, 0) to the point (x, y) is 



3. The polar equation for C in the usual polar coordinate system is 

4a cos 6 



sin 2 i 



With respect to a coordinate system with origin at F, the equation is 



(4.6.20) 



(4.6.21) 



(4.6.22) 



1 — cos# ' 
where I = 2a is half the latus rectum. 

4. Let P be any point of C. Then the ray PF and the horizontal line through P 
make the same angle with the tangent to C at P. Thus light rays parallel to the 
axis and re ected in the parabola converge onto F (principle of the parabolic 
re ecto r). 



4.6.6 CIRCLES 

The set of points in a plane whose distance to a x ed point (the center) is a xed 
positive number (the radius) is a circle. A circle of radius r and center (xo,yo) is 
described by the equation 

(x - x ) 2 + (y - y ) 2 =r\ (4.6.23) 
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x 2 + y 2 - 2xx - 2yy + x\ + y\ 



(4.6.24) 



Conversely, an equation of the form 



+ y 2 + 2dx + 2ey + f = 



(4.6.25) 



de nes a circle if d 2 +e 2 > /; the center is (— d, — e) and the radius is d 2 + e 2 — f. 

Three points not on the same line determine a unique circle. If the points have 
coordinates (x\ , y{), {x%, 2/2), and (x% ,2/3), then the equation of the circle is 



x 2 + y 2 
x\+y{ 
A +yl 

4 



x y 1 

x\ yi 1 

X2 y2 l 

xl + yi x 3 y 3 1 



(4.6.26) 



A chord of a circle is a line segment between two of its points (Figure 4.18). 
A diameter is a chord that goes through the center, or the length of such a chord 
(therefore the diameter is twice the radius). Given two points P\ = (x\,yi) and 
Pi = (x2 ,2/2), there is a unique circle whose diameter is Pi P2 ; its equation is 



(x - xi)(x - x 2 ) + (y - yi)(y - 2/2) = 0. 



(4.6.27) 



The length or circumference of a circle of radius r is 2nr, and the area is nr 2 . 
The length of the arc of circle subtended by an angle 6, shown as s in Figure 4.18, is 
r8. (All angles are measured in radians.) Other relations between the radius, the arc 
length, the chord, and the areas of the corresponding sector and segment are, in the 
notation of Figure 4. 18, 



d 



Rcos \Q 



^ccot \6 



2Rsm\9 = 2dtani6> = 2\/ R? - d 2 = ^Ah(2R-h), 



s id 
— = 2 cos -1 — 
R R 



„ 1 c 
2 tan -1 — 
2d 



„ . 1 c. 

2 sm" 1 — , 
2J?' 



area of sector : 
area of segment : 



7)R 2 9, 



\R 2 (e-sin6) = \(Rs-cd) 



R 2 cos" 1 



R 



d^/R 2 - d 2 



R 2 cos" 1 



R-h 
R 



(R- h)VlRh- h 2 . 



Other properties of circles: 



1. If the central angle AOB equals 6, the angle ACB, where C is any point on 
the circle, equals i<9 or 180° — \B (Figure 4.19, left). Conversely, given a 
segment AB, the set of points that "see" AB under a x ed angle is an arc of a 
circle (Figure 4.19, right). In particular, the set of points that see AB under a 
right angle is a circle with diameter AB. 

2. Let Pi, P%, P3, P4 be points in the plane, and let dij, for 1 < i,j < 4, be the 
distance between Pj and Pj . A necessary and suf cient condition for all of the 
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FIGURE 4.18 

The arc of a circle subtended by the angle 6 is s; the chord is c; the sector is the whole slice of 
the pie; the segment is the cap bounded by the arc and the chord ( that is, the slice minus the 
triangle). 



s 




FIGURE 4.19 

Left: the angle ACB equals \6 for any C in the long arc AB; ADB equals 180° — \B for 
any D in the short arc AB. Right: the locus of points, from which the segment AB subtends 
a xed angle 6, is an arc of the circle. 




points to lie on the same circle (or line) is that one of the following equalities 
be satis ed: 

±dr 2 d 3A ± dnd 2i ± di 4 d 23 = 0. (4.6.28) 
This is equivalent to Ptolemy's formula for cyclic quadrilaterals (page 323). 

3. In oblique coordinates with angle cj, a circle of center (xo, yo) an d radius r is 
described by the equation 

(x - x ) 2 + (y- y ) 2 + 2(x - x )(y - y ) cosw = r 2 . (4.6.29) 

4. In polar coordinates, the equation for a circle centered at the pole and having 
radius a is r = a. The equation for a circle of radius a passing through the 
pole and with center at the point (r, 6) = (a, #o) is r = 2a cos(# — #o)- The 
equation for a circle of radius a and with center at the point (r, 6) = (ro, #o) 
is 

r 2 - 2r r cos(6> - O ) + r 2 - a 2 = 0. (4.6.30) 
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5. If a line intersects a circle of center at points A and B, the segments OA 
and OB make equal angles with the line. In particular, a tangent line is per- 
pendicular to the radius that goes through the point of tangency. 

6. Fix a circle and a point P in the plane, and consider a line through P that 
intersects the circle at A and B (with A = B for a tangent). Then the product 
of the distances PA ■ PB is the same for all such lines. It is called the power 
of P with respect to the circle. 



4.7 SPECIAL PLANE CURVES 



4.7.1 ALGEBRAIC CURVES 

Curves that can be given in implicit form as f(x,y) = 0, where / is a polynomial, 
are called algebraic. The degree of / is called the degree or order of the curve. Thus, 
conies (page 325) are algebraic curves of degree two. Curves of degree three already 
have a great variety of shapes, and only a few common ones will be given here. 

The simplest case is the curve which is a graph of a polynomial of degree three: 
y = ax 3 + bx 2 + cx + d, with a ^ 0. This curve is a (general) cubic parabola 
(Figure 4.20), symmetric with respect to the point B where x = —b/3a. 

The equation of a semi-cubic parabola (Figure 4.21, left) is y 2 = kx 3 ; by pro- 
portional scaling one can take k = 1. This curve should not be confused with the 
cissoid of Diodes (Figure 4.21, middle), whose equation is (a — x)y 2 = x 3 with 
a ^ 0. 

The latter is asymptotic to the line x = a, whereas the semi-cubic parabola has 
no asymptotes. The cissoid's points are characterized by the equality OP = AB in 
Figure 4.21, middle. One can take a = 1 by proportional scaling. 



FIGURE 4.20 

The general cubic parabola for a > 0. For a < 0, re ect in a horizontal line. 




b 2 > 3ac b 2 = 3ac b 2 < 3ac 
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FIGURE 4.21 

The semi-cubic parabola, the cissoid of Diodes, and the witch ofAgnesi. 




More generally, any curve of degree three with equation (x — xo)y 2 = f(x), 
where / is a polynomial, is symmetric with respect to the a;-axis and asymptotic 
to the line x = xo- In addition to the cissoid, the following particular cases are 
important: 

1. The witch of Agnesi has equation xy 2 = a 2 (a — x), with a ^ 0, and is 
characterized by the geometric property shown in Figure 4.21, right. The same 
property provides the parametric representation x = a cos 2 6, y = a tan 8. 
Once more, proportional scaling reduces to the case a = 1. 

2. The folium of Descartes (Figure 4.22, left) is described by equation (x — 
a)y 2 = —x 2 (^x + a), with a ^ (reducible to a = 1 by proportional scal- 
ing). By rotating 1 35 ° (right) we get the alternative and more familiar equation 
x 3 + y 3 = cxy, where c = i \/2a. The folium of Descartes is a rational curve, 
that is, it is parametrically represented by rational functions. In the tilted po- 
sition, the equation is x = ct/(l + t 3 ), y = ct 2 /(l + t 3 ) (so that t = y/x). 

3. The strophoid's equation is (x — a)y 2 = —x 2 (x + a), with a ^ (reducible 
to a = 1 by proportional scaling). It satis es the property AP = AP' = OA 
in Figure 4.22, right; this means that POP' is a right angle. The strophoid's 
polar representation is r = — a cos 28 sec 8, and the rational parametric repre- 
sentation is x = a(t 2 - l)/(t 2 + l), y = at(t 2 - l)/(t 2 + l) (so that t = y/x). 

Among the important curves of degree four are the following: 

1. A Cassini's oval is characterized by the following condition: Given two foci 
F and F 1 , a distance 2a apart, a point P belongs to the curve if the product of 
the distances PF and PF' is a constant k 2 . If the foci are on the a;-axis and 
equidistant from the origin, the curve's equation is (x 2 + y 2 + a 2 ) 2 — Aa 2 x 2 = 
k 4 . Changes in a correspond to rescaling, while the value of k/a controls 
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FIGURE 4.22 

The folium of Descartes in two positions, and the strophoid. 




FIGURE 4.23 

Cassini's ovals for k = 0.5a, 0.9a, a, 1.1a and 1.5a (from the inside to the outside). The 
foci (dots) are at x = a and x = —a. The black curve, k = a, is also called Bernoulli's 
lemniscate. 




the shape: the curve has one smooth segment and one with a self-intersection, 
or two segments depending on whether k is greater than, equal to, or smaller 
than a (Figure 4.23). The case k = a is also known as the lemniscate (of Jakob 
Bernoulli); the equation reduces to (x 2 + y 2 ) 2 = a 2 (x 2 — y 2 ), and upon a 45° 
rotation to (x 2 + y 2 ) 2 = 2a 2 xy. Each Cassini oval is the section of a torus of 
revolution by a plane parallel to the axis of revolution. 

2. A conchoid of Nichomedes is the set of points such that the signed distance 
AP in Figure 4.24, left, equals a x ed real number k (the line L and the origin 
being x ed). If L is the line x = a, the conchoid's polar equation is r = 
a sec 8 + k. Once more, a is a scaling parameter, and the value of k/a controls 
the shape: when k > —a the curve is smooth, when k = —a there is a cusp, 
and when k < —a there is a self-intersection. The curves for k and — k can 
also be considered two leaves of the same conchoid, with Cartesian equation 
(x - a) 2 {x 2 + y 2 ) = k 2 x 2 . 

3. A limagon of Pascal is the set of points such that the distance AP in Fig- 
ure 4.25, left, equals a x ed positive number k measured on either side (the 
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FIGURE 4.24 

De ning property of the conchoid of Nichomedes (left), and curves for k = ±0.5a, k = ±a, 
and k = ±1.5a (right). 




FIGURE 4.25 

De ning property of the limacon of Pascal (left), and curves for k = 1.5a, k = a, and 
k = 0.5a (right). The middle curve is the cardioid; the one on the right a trisectrix. 




circle C and the origin O being x ed). If C has diameter a and center at 
(0, \a), the limacon's polar equation is r = a cos 9 + k, and its Cartesian 
equation is 

(x 2 +y 2 -ax) 2 = k 2 (x 2 +y 2 ). (4.7.1) 

The value of k/a controls the shape, and there are two particularly interesting 
cases. For k = a, we get a cardioid (see also page 341). For a = \k, we get 
a curve that can be used to trisect an arbitrary angle a. If we draw a line L 
through the center of the circle C making an angle a with the positive rc-axis, 
and if we call P the intersection of L with the limacon a = \k, the line from 
O to P makes an angle with L equal to |<x 

Hypocycloids and epicycloids with rational ratios (see next section) are also 
algebraic curves, generally of higher degree. 
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FIGURE 4.26 

Cycloid (top) and trochoids with k = 0.5a and k 
the center of the rolling circle to the pole. 



= 1.5a, where k is the distance PQ from 




4.7.2 ROULETTES (SPIROGRAPH CURVES) 

Suppose given a x ed curve C and a moving curve M, which rolls on C without 
slipping. The curve drawn by a point P kept x ed with respect to M is called a 
roulette, of which P is the pole. 

The most important examples of roulettes arise when M is a circle and C is 
a straight line or a circle, but an interesting additional example is provided by the 
catenary y = a cosh(x/a), which arises by rolling the parabola y = x 2 /(4a) on the 
x-axis with pole the focus of the parabola (that is, P = (0, a) in the initial position). 
The catenary is the shape taken under the action of gravity by a chain or string of 
uniform density whose ends are held in the air. 

A circle rolling on a straight line gives a trochoid, with the cycloid as a special 
case when the pole P lies on the circle (Figure 4.26). If the moving circle M has 
radius a and the distance from the pole P to the center of M is k, the trochoid's 
parametric equation is 

x = a(f> — k sin^, y = a — k cos <f). (4.7.2) 

The cycloid, therefore, has the parametric equation 

x = a((j> — sin (f>) , y = a(l — cos (j>) . (4.7.3) 

One can eliminate <j> to get a; as a (multivalued) function of y, which takes the fol- 
lowing form for the cycloid: 

x = ± cos" 1 (-^^j ~ \/ 2a V ~ V 2 ^ ( 4 - 7 - 4 ) 

The length of one arch of the cycloid is 8a, and the area under the arch is Sir a' 2 . 

A trochoid is also called a curtate cycloid when k < a (that is, when P is inside 
the circle) and a prolate cycloid when k > a. 
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FIGURE 4.27 

Left: initial con guration for epitrochoid (black) and con gu ration at parameter value 8 
(gray). Middle: epicycloid with b = \a (nephroid). Right: epicycloid with b = a (cardioid). 




A circle rolling on another circle and exterior to it gives an epitrochoid. If a is 
the radius of the x ed circle, b that of the rolling circle, and k is the distance from P 
to the center of the rolling circle, the parametric equation of the epitrochoid is 

x = (a + b) cos0 - fccos((l + b/a)0), y = (a + b) sin# - fcsin((l + b/a)0). 

(4.7.5) 

These equations assume that, at the start, everything is aligned along the positive 
:r-axis, as in Figure 4.27, left. Usually one considers the case when a /bis a rational 
number, say a/b = p/q where p and q are relatively prime. Then the rolling circle 
returns to its original position after rotating q times around the x ed circle, and the 
epitrochoid is a closed curve — in fact, an algebraic curve. One also usually takes 
k = b, so that P lies on the rolling circle; the curve in this case is called an epicycloid. 
The middle diagram in Figure 4.27 shows the case b = k = |o, called the nephroid; 
this curve is the cross section of the caustic of a spherical mirror. The diagram on the 
right shows the case b = k = a, which gives the cardioid (compare to Figure 4.25, 
middle). 

Hypotrochoids and hypocycloids are de ned in the same way as epitrochoids and 
epicycloids, but the rolling circle is inside the x ed one. The parametric equation of 
the hypotrochoid is 

x = (a — b) cos0 + kcos((a/b — 1)0), y = (a — b) sin# — ksin((a/b — 1)0), 

(4.7.6) 

where the letters have the same meaning as for the epitrochoid. Usually one takes 
a/b rational and k = b. There are several interesting particular cases: 

• b = k = a gives a point. 

• b = k = ha gives a diameter of the circle C . 

• b = k = ha gives the deltoid (Figure 4.28, left), whose algebraic equation is 

(x 2 + y 2 ) 2 - 8ax 3 + 24axy 2 + 18a 2 (a; 2 + y 2 ) - 27a 4 = 0. (4.7.7) 
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FIGURE 4.28 

The hypocycloids with a = 3b (deltoid) and a = 4b (astroid). 




• b = k = jci gives the astroid (Figure 4.28, right), an algebraic curve of de- 
gree six whose equation can be reduced to x 

2/3 + y 2/3 = fl 2/3^ The gure 

illustrates another property of the astroid: its tangent intersects the coordinate 
axes at points that are always the same distance a apart. Otherwise said, the 
astroid is the envelope of a moving segment of x ed length whose endpoints 
are constrained to lie on the two coordinate axes. 



4.7.3 CURVES IN POLAR COORDINATES 



polar equation 



type of curve 



r = a 

r = a cos 6 

r = a sin 



2br cos(8 - /3) + (b 2 -a 2 ) = 



k 



1 — ecosO 



circle 
circle 
circle 

circle at (b, /?) of radius a 
e = 1 parabola 
< e < 1 ellipse 
e > 1 hyperbola 



4.7.4 SPIRALS 

A number of interesting curves have polar equation r = f(6), where / is a mono- 
tonic function (always increasing or decreasing). This property leads to a spiral 
shape. The logarithmic spiral or Bernoulli spiral (Figure 4.29, left) is self-similar: 
by rotation the curve can be made to match any scaled copy of itself. Its equation 
is r = ke a0 ; the angle between the radius from the origin and the tangent to the 
curve is constant and equal to <j> = cot -1 a. A curve parameterized by arc length 
and such that the radius of curvature is proportional to the parameter at each point is 
a Bernoulli spiral. 

In the Archimedean spiral or linear spiral (Figure 4.29, middle), the spacing 
between intersections along a ray from the origin is constant. The equation of this 
spiral is r = a6; by scaling one can take a = 1. It has an inner endpoint, in contrast 
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FIGURE 4.29 

The Bernoulli or logarithmic spiral (left), the Archimedes or linear spiral (middle), and the 
Cornu spiral ( right). 




with the logarithmic spiral, which spirals down to the origin without reaching it. The 
Cornu spiral or clothoid (Figure 4.29, right), important in optics and engineering, 
has the following parametric representation in Cartesian coordinates: 

X = aC(t) = a ( cos(|tts 2 ) ds, y = aS(t) = a [ sin(±7rs 2 ) ds. (4.7.8) 
Jo Jo 

(C and S are the so-called Fresnel integrals; see page 547.) A curve parameterized 
by arc length and such that the radius of curvature is inversely proportional to the 
parameter at each point is a Cornu spiral (compare to the Bernoulli spiral). 



4.7.5 THE PEANO CURVE AND FRACTAL CURVES 

There are curves (in the sense of continuous maps from the real line to the plane) 
that completely cover a two-dimensional region of the plane. We give a construction 
of such a Peano curve, adapted from David Hilbert's example. The construction 
is inductive and is based on replacement rules. We consider building blocks of six 

shapes: ^ ' f | , the length of the straight segments being twice 

the radius of the curved ones. A sequence of these patterns, end-to-end, represents a 
curve, if we disregard the gray and black half -disks. The replacement rules are the 
following: 

r r ~\ ^ , 

1111 1 1 
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The rules are applied taking into account the way each piece is turned. Here we 
apply the replacement rules to a particular initial pattern: 




(We scale the result so it has the same size as the original.) Applying the process 
repeatedly gives, in the limit, the Peano curve. Note that the sequence converges 
uniformly and thus the limit function is continuous. Here are the first five steps: 



The same idea of replacement rules leads to many interesting fractal, and often 

self-similar, curves. For example, the substitution _J\_ leads to the 

Koch snowflake when applied to an initial equilateral triangle, like this (the rst three 
stages and the sixth are shown): 




4.7.6 FRACTAL OBJECTS 

Given an object X, if n(e) open sets of diameter of e are required to cover X, then 
the capacity dimension of X is 

lnn(e) 



d, 



capacity 



lim 



>o lne 

indicating that n(e) scales as e da v* chy . Note that 

^correlation ^ ^information ^ ^capacity • 

The capacity dimension of various objects: 



(4.7.9) 
(4.7.10) 



Object Dimension 


Object Dimension 


Logistic equation 0.538 
Cantor set ?s 0.6309 
Koch snowflake ^ « 1.2619 
Cantor dust ^ « 1.4650 

In 3 

Minkowski sausage | = 1.5 


Sierpihski sieve |s| ?s 1.5850 
Pentaake £^±*| * 1.8617 
Sierpihski carpet ^ ?s 1.8928 
Tetrix ' 2 
Menger sponge 2 ln , 2 + ln 5 ?s 2.7268 
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4.7.7 CLASSICAL CONSTRUCTIONS 



The ancient Greeks used straightedges and compasses to nd the solutions to numer- 
ical problems. For example, they found square roots by constructing the geometric 
mean of two segments. Three famous problems that have been proved intractable by 
this method are: 

1. The trisection of an arbitrary angle. 

2. The squaring of the circle (the construction of a square whose area is equal to 
that of a given circle). 

3. The doubling of the cube (the construction of a cube with double the volume 
of a given cube). 

A regular polygon inscribed in the unit circle can be constructed by straightedge 
and compass alone if, and only if, n has the form n = 2 l p\pi ■ ■ -Pk, where £ is a 
nonnegative integer and the {p^ are zero or more distinct Fermat primes (primes of 
the form 2 2 -I- 1). The only known Fermat primes are for 3, 5, 17, 257, and 65537, 
corresponding to m = 0,1,2,3,4. Thus, regular polygons can be constructed for 
n = 3, 4, 5, 6, 8, 10, 12, 15, 16, 17, 20, 24, ... , 257, .... 



4.8 COORDINATE SYSTEMS IN SPACE 

4.8.0.1 Conventions 

When we talk about "the point with coordinates (x, y, z)" or "the surface with equa- 
tion f(x,y,z)", we always mean Cartesian coordinates. If a formula involves an- 
other type of coordinates, this fact will be stated explicitly. Note that Section 4.1.2 
has information on substitutions and transformations relevant to the three-dimensional 
case. 



4.8.1 CARTESIAN COORDINATES IN SPACE 

In Cartesian coordinates (or rectangular coordinates), a point P is referred to by 
three real numbers, indicating the positions of the perpendicular projections from the 
point to three x ed, perpendicular, graduated lines, called the axes. If the coordinates 
are denoted x,y, z, in that order, the axes are called the x-axis, etc., and we write 
P = (x,y,z). Often the x-axis is imagined to be horizontal and pointing roughly 
toward the viewer (out of the page), the y-axis also horizontal and pointing more 
or less to the right, and the z-axis vertical, pointing up. The system is called right- 
handed if it can be rotated so the three axes are in this position. Figure 4.30 shows a 
right-handed system. The point x = 0, y = 0, z = is the origin, where the three 
axes intersect. 
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FIGURE 4.30 

In Cartesian coordinates, P = (4.2, 3.4, 2.2). 



z 




FIGURE 4.31 

Among the possible sets (r,8,z) of cylindrical coordinates for P are (10, 30°, 5) and 
(10, 390°, 5). 



z 




4.8.2 CYLINDRICAL COORDINATES IN SPACE 

To de ne cylindrical coordinates, we take an axis (usually called the z-axis) and a 
perpendicular plane, on which we choose a ray (the initial ray) originating at the 
intersection of the plane and the axis (the origin). The coordinates of a point P are 
the polar coordinates (r, 8) of the projection of P on the plane, and the coordinate z 
of the projection of P on the axis (Figure 4.31). See Section 4. 1.4 for remarks on the 
values of r and 6. 



4.8.3 SPHERICAL COORDINATES IN SPACE 

To de ne spherical coordinates, we take an axis (the polar axis) and a perpendicular 
plane (the equatorial plane), on which we choose a ray (the initial ray) originating 
at the intersection of the plane and the axis (the origin O). The coordinates of a point 
P are the distance p from P to the origin, the angle <f> (zenith) between the line OP 
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and the positive polar axis, and the angle 9 {azimuth) between the initial ray and the 
projection of OP to the equatorial plane. See Figure 4.32. As in the case of polar 
and cylindrical coordinates, 6 is only defined up to multiples of 360 °, and likewise <j>. 
Usually <j> is assigned a value between and 180°, but values of <f> between 180° and 
360° can also be used; the triples (p, <j>, 6) and (p, 360° — <j>, 180° + 6) represent the 
same point. Similarly, one can extend p to negative values; the triples (p, <j>, 6) and 
(-p, 180° - (j>, 180° + 0) represent the same point. 



FIGURE 4.32 

A set of spherical coordinates for P is (p, 8, <j>) = (10, 60°, 30°). 




P 



FIGURE 4.33 

Standard relations between Cartesian, cylindrical, and spherical coordinate systems. The 
origin is the same for all three. The positive z-axes of the Cartesian and cylindrical systems 
coincide with the positive polar axis of the spherical system. The initial rays of the cylindrical 
and spherical systems coincide with the positive x-axis of the Cartesian system, and the rays 
6 = 90° coincide with the positive y-axis. 
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4.8.4 RELATIONS BETWEEN CARTESIAN, CYLINDRICAL, AND 
SPHERICAL COORDINATES 



Consider a Cartesian, a cylindrical, and a spherical coordinate system, related as 
shown in Figure 4.33. The Cartesian coordinates (x,y,z), the cylindrical coordi- 
nates (r, 8, z), and the spherical coordinates (p, <f>, 8) of a point are related as follows 
(where the tan -1 function must be interpreted correctly in all quadrants): 

' " V 

i—. — — - sin <7 = — = 

r 



cart -H- cyl 



x = r cos f 
y = r sin 6 

z = z, 



8 = tan 

l> z = z, 



V 'x 2 + y 2 , 

i 1 

x 



COS( 



\fx 2 +y 2 
x 

\/x 2 +y 2 



cyl -H- sph 



psm (j 
pcos< 



V / r 2 + z 2 , 



tan -, 

z 



sin ( 



cos 4> ■ 



Vr 2 + z 2 ' 

z 



\/r 2 + z 



2' 



cart o sph 



x = p cos 8 sin i 
y = psinS sin <; 

z = pCOS(f), 



p = y/x 2 +y 2 + z 2 , 



tan" 1 -, 



tan 



cos 



-i \fx r ^ r y i 



\/ x 2 + y 2 + z 2 



4.8.5 HOMOGENEOUS COORDINATES IN SPACE 

A quadruple of real numbers (x : y : z : t), with t ^ 0, is a set of homogeneous 
coordinates for the point P with Cartesian coordinates (x/t, y/t, z/t). Thus the 
same point has many sets of homogeneous coordinates: (x : y : z : t) and (x' : y' : 
z' : t 1 ) represent the same point if, and only if, there is some real number a such that 
x' = ax, y' = ay, z' = az, t' = at. If P has Cartesian coordinates (xq, yo, zo), 
one set of homogeneous coordinates for P is (xq, yo, zo, 1)- 

Section 4.1.5 has more information on the relationship between Cartesian and 
homogeneous coordinates. Section 4.9.2 has formulae for space transformations in 
homogeneous coordinates. 



4.9 SPACE SYMMETRIES OR ISOMETRIES 

A transformation of space (invertible map of space to itself) that preserves distances 
is called an isometry of space. Every isometry of space is a composition of transfor- 
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mations of the following types: 



1 . The identity (which leaves every point fixed) 

2. A translation by a vector v 

3. A rotation through an angle a around a line L 

4. A screw motion through an angle a around a line L, with displacement d 

5. A re ection in a plane P 

6. A glide-re e ction in a plane P with displacement vector v 

7. A rotation-re ection (rotation through an angle a around a line L composed 
with reflection in a plane perpendicular to L). 

The identity is a particular case of a translation and of a rotation; rotations are 
particular cases of screw motions; reflections are particular cases of glide-reflections. 
However, as in the plane case, it is more intuitive to consider each case separately. 



4.9.1 FORMULAE FOR SYMMETRIES: CARTESIAN 
COORDINATES 

In the formulae below, multiplication between a matrix and a triple of coordinates 
should be carried out regarding the triple as a column vector (or a matrix with three 
rows and one column). 

1 . Translation by (xq ,yo,zo): 

(x,y,z) i y (x + x , y + y , z + z ). (4.9.1) 

2. Rotation through a (counterclockwise) around the line through the origin with 
direction cosines a, b, c (see page 353): (x, y, z) h-> M(x, y, z), where M is 
the matrix 

a 2 (1 — cos a) + cos a ab(l — cos a) — csina ac( 1 — cos a) + b sin a 
ab(l — cos a) + c sin a b 2 (1 — cos a) + cos a bc(l — cos a) — a sin a . 
ac( 1 — cos a) — b sin a bc(l — cos a) + a sin a c 2 (l — cos a) + cos a 

(4.9.2) 

3. Rotation through a (counterclockwise) around the line with direction cosines 
a,b,c through an arbitrary point (xq, yo, zq): 

(x,y,z) H- (x ,y ,z ) + M(x - x , y - y , z - z ), (4.9.3) 

where M is given by Equation (4.9.2). 

4. Arbitrary rotations and Euler angles: Any rotation of space fixing the origin 
can be decomposed as a rotation by <p about the z-axis, followed by a rotation 
by 9 about the y-axis, followed by a rotation by ip about the ,z-axis. The 
numbers <f>, 8, and ip are called the Euler angles of the composite rotation, 
which acts as: (x, y, z) h-> M(x, y, z), where M is the matrix given by 

cos (f> cos 9 cos ip — sin <j> sin ip — sin <j> cos 6 cos ip — cos <j> sin ip sin 6 cos ip 
cos (j> cos 9 sin ip + sin <j> cos ip — sin <j> cos 6 sin ip + cos <j> cos ip sin 6 sin ^ . 
— cos (j> sin 6 sin ^ sin ^ cos 

(4.9.4) 
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FIGURE 4.34 

The coordinate rays Ox, Oy, Oz, together with their images 0£, Or), OC, under a rotation, x 
the Euler angles associated with that rotation, as follows: 6 = zOC,, ip = xOr = yOs, and 
(j> = sOrj. (Here the ray Or is the projection of OC, to the xy-plane. The ray Os is determined 
by the intersection of the xy- and ^r]-planes.) 



(An alternative decomposition, more natural if we think of the coordinate 
system as a rigid trihedron that rotates in space, is the following: a rotation 
by ip about the z-axis, followed by a rotation by 8 about the rotated y-axis, 
followed by a rotation by <p about the rotated z -axis. Note that the order is 
reversed.) 

Provided that 6 is not a multiple of 180°, the decomposition of a rotation in 
this form is unique (apart from the ambiguity arising from the possibility of 
adding a multiple of 360° to any angle). Figure 4.34 shows how the Euler 
angles can be read off geometrically. 

Warning: Some references define Euler angles differently; the most common 
variation is that the second rotation is taken about the x-axis instead of about 
the y-axis. 

5. Screw motion with angle a and displacement d around the line with direction 
cosines a, b, c through an arbitrary point (xo, yo, zo)'- 

(x,y,z) h-> (x + ad,yo + bd,zo + cd) + M(x-x , y-yo, z-z Q ), (4.9.5) 
where M is given by (4.9.2). 

6. Re ec Hon 



z 




c 



X 



in the a;y-plane: 
in the xz -plane: 
in the yz-plane: 



(x,y,z) i ^ (x, y, -z). 
(x,y,z) i ^ (x, -y, z). 
(x,y,z) i ^ (-x, y, z). 



(4.9.6) 
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7. Re ec tion in a plane with equation ax + by + cz + d = 0: 

V, z) >-> _ 9 , 5 , _ 9 (Af (a:o, 2/o, *o) - (2od, 26d, 2cd)) , (4.9.7) 



a 2 + b 2 + c 2 
where Af is the matrix 

~ -a 2 + b 2 + c 2 
M = -2ab 
-2ac 



-2ab 
a 2 -b 2 + c 2 
-26c 



-2ac 
-2bc 
a 2 +b 2 - c 2 



(4.9.8) 



8. Re ec tion in a plane going through (xq, yo, zq) and whose normal has direc- 
tion cosines a, b, c: 

(x,y,z) i y (x +y + z ) + M(x - x , y - y , z - z ), (4.9.9) 

where M is as in (4.9.8). 

9. Glide-re ection in a plane P with displacement vector v: Apply first a reflec- 
tion in P, then a translation by the vector v. 



4.9.2 FORMULAE FOR SYMMETRIES: HOMOGENEOUS 
COORDINATES 

All isometries of space can be expressed in homogeneous coordinates in terms of 
multiplication by a matrix. As in the case of plane isometries (Section 4.2.2), this 
means that the successive application of transformations reduces to matrix multipli- 
cation. (In the formulae below, [ ¥ 5 ] is the 4x4 projective matrix obtained from 
the 3x3 matrix M by adding a row and a column as stated.) 



1 . Translation by (xq ,yo,zo): 



1 x 

1 

1 z 

1 



2. Rotation through the origin: 



M 
1 



where M is given in (4.9.2) or (4.9.4), as the case may be. 



3. Re ec tion in a plane through the origin: 
where M is given in (4.9.8). 



M 
1 



From this one can deduce all other transformations, as in the case of plane trans- 
formations (see page 305). 
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4.10 OTHER TRANSFORMATIONS OF SPACE 



4.10.1 SIMILARITIES 



A transformation of space that preserves shapes is called a similarity. Every simi- 
larity of space is obtained by composing a proportional scaling transformation (also 
known as a homothety) with an isometry. A proportional scaling transformation cen- 
tered at the origin has the form 

(x,y, z) h-> (ax,ay,az), (4.10.1) 

where a ^ is the scaling factor (a real number). The corresponding matrix in 
homogeneous coordinates is 

"a 0' 
a 
a ~ a 
1 

In cylindrical coordinates, the transformation is (r, 9, z) h-> (ar, 9, az). In spherical 
coordinates, it is (r, <j>, 9) h-> (ar, <f>, 9). 



(4.10.2) 



4.10.2 AFFINE TRANSFORMATIONS 

A transformation that preserves lines and parallelism (maps parallel lines to parallel 
lines) is an afne transformation. There are two important particular cases of such 
transformations: 



1. A non-proportional scaling transformation centered at the origin has the form 
(x, y, z) h-> (ax, by, cz), where a,b,c ^ are the scaling factors (real num- 
bers). The corresponding matrix in homogeneous coordinates is 

'a 0" 

6 

c ' 

1 



H a ,b,c 



(4.10.3) 



2. A shear in the ^-direction and preserving horizontal planes has the form (x, y, z) 
h-> (x + rz,y, z), where r is the shearing factor. The corresponding matrix in 
homogeneous coordinates is 




1 






(4.10.4) 



Every affine transformation is obtained by composing a scaling transformation with 
an isometry, or one or two shears with a homothety and an isometry. 
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4.10.3 PROJECTIVE TRANSFORMATIONS 



A transformation that maps lines to lines (but does not necessarily preserve paral- 
lelism) is a projective transformation. Any spatial projective transformation can be 
expressed by an invertible 4x4 matrix in homogeneous coordinates; conversely, any 
invertible 4x4 matrix defines a projective transformation of space. Projective trans- 
formations (if not affine) are not defined on all of space, but only on the complement 
of a plane (the missing plane is "mapped to infinity"). 

The following particular case is often useful, especially in computer graphics, 
in projecting a scene from space to the plane. Suppose an observer is at the point 
E = (xo,yo,zo) of space, looking toward the origin O = (0,0,0). Let P, the 
screen, be the plane through O and perpendicular to the ray EO. Place a rectangular 
coordinate system £77 on P with origin at O so that the positive r/-axis lies in the half- 
plane determined by E and the positive z-axis of space (that is, the z-axis is pointing 
"up" as seen from E). Then consider the transformation that associates with a point 
X = (x, y, z) the triple (£, 77, (), where (£, rj) are the coordinates of the point, where 
the line EX intersects P (the screen coordinates of X as seen from E), and £ is the 
inverse of the signed distance from X to E along the line EO (this distance is the 
depth of X as seen from E). This is a projective transformation, given by the matrix 



(4.10.5) 



-r 2 yo 


r 2 x 








-rx z 


-ryozo 


rp 














rp 


-px 


-pyo 


-pzo 


r 2 p 



with p = y/x 2 + yl and r = y/x* + yl + z 2 . 



4.1 1 DIRECTION ANGLES AND DIRECTION 
COSINES 



Given a vector (a, b, c) in three-dimensional space, the direction cosines of this vec- 
tor are 



cos a 



cos /3 



cos 7 



a 


\/a? 


+ b 2 + c 2 




b 




+ b 2 +c 2 




c 



(4.11.1) 



Va 2 +b 2 +c 2 



Here the direction angles a, f3, 7 are the angles that the vector makes with the posi- 
tive x-, y- and 2;-axes, respectively. In formulae, usually the direction cosines appear, 
rather than the direction angles. We have 

cos 2 a + cos 2 P + cos 2 7 = 1. (4.11.2) 
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4.12 PLANES 



The (Cartesian) equation of a plane is linear in the coordinates x, y, and z: 

ax + by + cz + d = 0. (4.12.1) 

The normal direction to this plane is (a, b, c). The intersection of this plane with the 
a;-axis, or x-intercept, is x = —d/a, the y-intercept is y = —d/b, and the z-intercept 
is z = —d/c. The plane is vertical (perpendicular to the xy-p\ane) if c = 0. It is 
perpendicular to the a;-axis if b = c = 0, and likewise for the other coordinates. 

When a 2 + b 2 + c 2 = 1 and d < in the equation ax + by + cz + d = 0, the 
equation is said to be in normal form. In this case —d is the distance of the plane to 
the origin, and (a, b, c) are the direction cosines of the normal. 

To reduce an arbitrary equation ax + by + cz + d = to normal form, divide by 
±\/a 2 + b 2 + c 2 , where the sign of the radical is chosen opposite the sign of d when 
d ^ 0, the same as the sign of c when d = and c ^ 0, and the same as the sign of 
b otherwise. 



4.12.1 PLANES WITH PRESCRIBED PROPERTIES 

1. Plane through (xq, yo, zq) and perpendicular to the direction (a, b, c): 

a(x - x ) + b(y - y ) + c(z - z ) = 0. (4.12.2) 

2. Plane through (xo,yo,zo) and parallel to the two directions {a\,b\,c\) and 
(a 2 ,&2,c 2 ): 

x - x y - yo z - z 

ai h ci =0. (4.12.3) 

a-i b-2 C2 



3. Plane through (xo,yo, zo) and (x\,yi,zi) and parallel to the direction (a, b, c): 

0. (4.12.4) 



x - x y - yo z - z 

xi -x yi - y zi - z 
a b c 



4. Plane going through (x , yo, zo), {x\ , yi , zi), and (x 2 ,y2,z 2 ): 
x y z 1 
xo Vo z 1 



x\ yi zi 1 
a^2 J/2 z 2 1 







or 



x - x y -yo z - z 
x\ - xo yi - yo z 1 - z 
X2 -x J/2 - 2/o z 2 - z 



(4.12.5) 



(The last three formulae remain true in oblique coordinates.) 



5. The distance from the point (xq, yo, zo) to the plane ax + by + cz + d = is 

ax + by + cz + d 



Va 2 + b 2 +c 2 



(4.12.6) 
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6. The angle between two planes a^x + boy + cqz + do = and a\x + b\y + 
c\ z 4- d\ =0 is 

_! a ai + b b! + c ci 
cos — (4.12.7) 

y/al + b 2 +<%yja{ +bj + cf 

In particular, the two planes are parallel when ao ■ bo ■ cq = a\ : b\ : c\, and 
perpendicular when aocii + bobi + coC\ = 0. 



4.12.2 CONCURRENCE AND COPLANARITY 



Fourplanes aox+boy+coz+do = Q,a\x+biy+c\z+di = 0, a2X+b2y+C2Z+d2 = 
0, and a^x + b%y + c^z + d% = are concurrent (share a point) if and only if 

ao b c d 

ai I 1 Cl d } =0. (4.12.8) 

a 2 o 2 c 2 a 2 

a3 &3 c 3 d 3 

Four points (x ,yo,z ), (x 1 ,y 1 ,z 1 ), (x2,y2,z 2 ), and (x 3 ,y 3 , z 3 ) are coplanar (lie 
on the same plane) if and only if 



x 

Xi 
X2 
X 3 



yo 

Vi 



zo 

Z\ 

Z2 
Z 3 



(4.12.9) 



(Both of these assertions remain true in oblique coordinates.) 



4.13 LINES IN SPACE 

Two planes that are not parallel or coincident intersect in a straight line, such that 
one can express a line by a pair of linear equations 

ax + by + cz + d = 1 

+ b'y + c'z + d' =0/ 1 j 

such that 6c' — c6', ca' — ac', and ab' — ba! are not all zero. The line thus defined is 
parallel to the vector (be 1 — cb 1 , ca 1 — ac 1 , ab 1 — ba 1 ). The direction cosines of the line 
are those of this vector. See Equation (4.11.1). (The direction cosines of a line are 
only defined up to a simultaneous change in sign, because the opposite vector still 
gives the same line.) 

The following particular cases are important: 



J ax 
\a'x 



1. Line through (xq, yo, zo) parallel to the vector (a, b, c): 

x-xo y - yo z - z 



(4.13.2) 
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2. Line through (x ,y ,z ) and (xi,yi,zi): 

x -x y - yo z - z 



x\ -x 2/1 - 2/o zi - z 
This line is parallel to the vector {x\ — xq, yi — yo, z\ — zq). 



(4.13.3) 



4.13.1 DISTANCES 



1 . The distance between two points in space is the length of the line segment 
joining them. The distance between the points {xo,yo, zq) and (x\,yi,zi) is 

y/( Xl - x ) 2 + (2/1 - yo) 2 + (zi - z ) 2 . (4.13.4) 

2. The point k% of the way from P = (xo,yo, zo) to P\ = {x\ , y\ , z\ ) is 
(kxx +(100-A;)a;o ky x + (100 - k)y kz x + (100 - k)z 



100 ' 100 ' 100 ) ' (4 - 13 - 5) 

(The same formula also applies in oblique coordinates.) This point divides the 
segment P$P\ in the ratio k : (100 — k). As a particular case, the midpoint of 
fb^i is given by 

' xi +x 2/i +2/o zi + z \ {4 | , ( _ 

3. The distance between the point (xo, yo, zo) and the line through (xi , yi, z\) in 
direction (a, b, c): 



\ 







2 




2 




2 




2/o - 2/i z - zi 
b c 


+ 


Zo - Zi x - x 1 


+ 


xo - xi y - 2/i 
a b 








c a 







a 2 + b 2 + c 2 



(4.13.7) 



4. The distance between the line through (xo, yo, zo) in direction (ao, bo, Co) and 
the line through {x\,y\, z\) in direction (ai, foi, ci): 



a^i - xo 2/i - 2/o ^i - zo 
ao bo Co 

a\ b\ c\ 



bo Co 
bi ci 



+ 



Co a Q 
c\ a\ 



+ 



ao b 
a 1 b 1 



(4.13.8) 



4.13.2 ANGLES 

Angle between lines with directions (xo,yo,zo) and {x\,y\,z\): 

_! a ai + boh + c ci 
cos . — =. (4.13.9) 

\/ao+ 6 o + c o\/ a i+ 6 ?+ c ? 

In particular, the two lines are parallel when ao : &o : Co = ai : b\ : c\, and 

perpendicular when do^i + ^o^i + CqC\ = 0. 
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Angle between lines with direction angles ao , /?o , 7o an d ctx, 0i , 7i : 

cos -1 (cos ao cosai + cos (3q cos Pi + cos 70 cos 71). (4.13.10) 



4.13.3 CONCURRENCE, COPLANARITY, PARALLELISM 

Two lines, each specified by point and direction, are coplanar if, and only if, the 
determinant in the numerator of Equation (4.13.8) is zero. In this case they are 
concurrent (if the denominator is non-zero) or parallel (if the denominator is zero). 

Three lines with directions (ao, bo, Co), (ai,bi,C\), and (02, 62, C2) are parallel 
to a common plane if and only if 

ao b Co 

01 61 ci =0. (4.13.11) 

Cl2 &2 C2 



4.14 POLYHEDRA 

For any polyhedron topologically equivalent to a sphere — in particular, for any con- 
vex polyhedron — the Euler formula holds: 

v-e + f = 2, (4.14.1) 

where v is the number of vertices, e is the number of edges, and / is the number of 
faces. 

Many common polyhedra are particular cases of cylinders (Section 4.15) or 
cones (Section 4.16). A cylinder with a polygonal base (the base is also called a 
directrix) is called a prism. A cone with a polygonal base is called a pyramid. A 
frustum of a cone with a polygonal base is called a truncated pyramid. Formu- 
lae (4.15.1), (4.16.1), and (4.16.2) give the volumes of a general prism, pyramid, and 
truncated pyramid. 

A prism whose base is a parallelogram is a parallelepiped. The volume of a 
parallelepiped with one vertex at the origin and adjacent vertices at {x\, j/i, z{), 
(%2 ,2/2,-2), and (x 3 , y 3 , z 3 ) is given by 

x\ yi zi 

volume = £2 Vi z% . (4.14.2) 

x 3 V3 z 3 

The rectangular parallelepiped is a particular case: all of its faces are rectangles. If 
the side lengths are a, b, c, the volume is abc, the total surface area is 2(ab + ac + bc), 
and each diagonal has length v 'a 2 +b 2 + c 2 . When a = b = c we get the cube. See 
Section 4.14.1. A pyramid whose base is a triangle is a tetrahedron. The volume 
of a tetrahedon with one vertex at the origin and the other vertices at (x i,yi, z\), 
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(x2 , 2/2, 22), and (x 3 , y 3 , z 3 ) is given by 



volume = 

In a tetrahedron with vertices Po, Pi, 
from Pi to Pj . Form the determinants 



Xi 
X-2 

x 3 

, Pi, 






1 


1 


1 


1 


1 





rP 
"01 


rP 

"02 


rP 
"03 


1 


4i 





dl2 


dl3 


1 


"02 







d 2 
"23 


1 


"03 


d\ 3 


r/ 2 

"23 






and T 



yi zi 

y-2 z 2 . (4.14.3) 

2/3 z 3 

let djj be the distance (edge length) 



(4.14.4) 






4i 


f/ 2 
"02 


rP 
"03 


4i 





dh 


4. 


rP 
"02 







f/ 2 

"23 


rP 
"03 




r/ 2 

"23 






Then the volume of the tetrahedron is i/|A|/288, and the radius of the circumscribed 
sphere is, |- N /|r/2A|. 

Expanding the determinant we find that the volume V satisfies the formula: 



144V' 



01^12 4 



-d { 
+ dl t& 



rl 2 

i"ia 



~d { 

+ ^12 "02 



rP rP 

01 "13 "03 

2 d? 



<7 2 <7 2 <7 2 

"12"13": 



+ d, 2 



01 



3 "23 

-2 
03 



d 2 2 di 



rP 

"02 "03 "23 
+ d 2 d 2 d 2 

T "12 "02 "03 



+ r/ 2 d 2 r/ 2 
-I- «i2"i3"03 

+ ^01^13^23 + 



+ d 2 r/ 2 r/ 2 
^ "02 "13 "03 



+ cP cP rfi 
-1- "01 "12 "23 



' 2 ^ 2 d 2 



(P (P (P 
"02 "02 "13 



(P (P rf 
"01 "01": 



' 2 rP 
2 "03 

-2 
23 



"l3"23 

(P (P (P 
"02 "13 "13 

(P (P (P 

"12 "03 "03 

(P (P (P 

"01 "23 "23 



rP rP 
01 "03 "23 



+ d 01 d, 
+ 4 



02' 



rP rP 
"03 "23 



(4.14.5) 



(Mnemonic: Each of the first four negative terms corresponds to a closed path around 
a face; each positive term to an open path along three consecutive edges; each re- 
maining negative term to a pair of opposite edges with weights 2 and 1 . All such 
edge combinations are represented.) 

For an arbitrary tetrahedron, let P be a vertex and let a, b, c be the lengths of the 
edges converging on P. If A, B, C are the angles between the same three edges, the 
volume of the tetrahedron is 



V 



-abcyfl 



6 



cos 2 A - cos 2 B - cos 2 C + 2 cos A cos B cos C. (4. 14.6) 



4.14.1 CONVEX REGULAR POLYHEDRA 

Figure 4.35 shows the five regular polyhedra, or Platonic solids. In the following 
tables and formulae, a is the length of an edge, 9 the dihedral angle at each edge, R 
the radius of the circumscribed sphere, r the radius of the inscribed sphere, V the 
volume, S the total surface area, v the total number of vertices, e the total number of 
edges, / the total number of faces, p the number of edges in a face (3 for equilateral 
triangles, 4 for squares, 5 for regular pentagons), and q the number of edges meeting 
at a vertex. 
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FIGURE 4.35 

The Platonic solids. Top: the tetrahedron (self-dual). Middle: the cube and the octahedron 
(dual to one another). Bottom: the dodecahedron and the icosahedron (dual to one another). 




(4.14.7) 



Name 


V 


e 


/ 


P 


Q 


sin# 


e 


Regular tetrahedron 


4 


6 


4 


3 


3 


2^2/3 


70°31'44" 


Cube 


8 


12 


6 


4 


3 


1 


90° 


Regular octahedron 


6 


12 


8 


3 


4 


2i/2/3 


109°28'16" 


Regular dodecahedron 


20 


30 


12 


5 


3 


2/V5 


116°33'54" 


Regular icosahedron 


12 


30 


20 


3 


5 


2/3 


138°11'23" 
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Name 


R/a 


r /a 


Tetrahedron 

Octahedron 

Dodecahedron 

Icosahedron 


VE/4 0.612372 
\F\li n 866095 
^2/2 0.707107 
^(v^+a/S) 1.401259 
^10 + 2^/5 0.951057 


^/12 0.204124 

1 OS 

2 u -° 

1/6/6 0.408248 
^^250 + 110^/5 1.113516 
^42 + 18^5 0.755761 



Name 


S/a 2 


V/a 3 


Tetrahedron 
Cube 

Octahedron 

Dodecahedron 

Icosahedron 


V3 1.73205 
6 6. 
2V^ 3.46410 
3^25 + 10^/5 20.64573 
5^ 8.66025 


V2/12 0.117851 

1 1. 
n/2/3 0.471405 
|(15 + 7V5) 7.663119 
^(3 + ^5) 2.181695 



4.14.2 POLYHEDRA NETS 

Nets for the five Platonic solids are shown: a) tetrahedron, b) octahedron, c) icosa- 
hedron, d) cube, and e) dodecahedron. Paper models can be made by making an 
enlarged photocopy of each, cutting them out along the exterior lines, folding on the 
interior lines, and using tape to join the edges. 
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FIGURE 4.36 

Left: an oblique cylinder with generator L and directrix C. Right: a right circular cylinder. 




4.15 CYLINDERS 

Given a line L and a curve C in a plane P, the cylinder with generator L and directrix 
C is the surface obtained by moving L parallel to itself, so that a point of L is always 
on C . If L is parallel to the z-axis, the surface's implicit equation does not involve 
the variable z. Conversely, any implicit equation that does not involve one of the 
variables (or that can be brought to that form by a change of coordinates) represents 
a cylinder. 

If C is a simple closed curve, we also apply the word cylinder to the solid en- 
closed by the surface generated in this way (Figure 4.36, left). The volume contained 
between P and a plane P' parallel to P is 

V = Ah = Al sm6, (4.15.1) 

where A is the area in the plane P enclosed by C, h is the distance between P and P ' 
(measured perpendicularly), I is the length of the segment of L contained between 
P and P', and 8 is the angle that L makes with P. When 8 = 90° we have a right 
cylinder, and h = I. For a right cylinder, the lateral area between P and P' is hs, 
where s is the length (circumference) of C . 

The most important particular case is the right circular cylinder (often simply 
called a cylinder). If r is the radius of the base and h is the altitude (Figure 4.36, 
right), the lateral area is litrh, the total area is 2irr(r + h), and the volume is irr h. 
The implicit equation of this surface can be written x 2 + y 2 = r 2 ; see also page 364. 



4.16 CONES 

Given a curve C in a plane P and a point O not in P, the cone with vertex O and 
directrix C is the surface obtained as the union of all rays that join O with points 
of C . If O is the origin and the surface is given implicitly by an algebraic equation, 
that equation is homogeneous (all terms have the same total degree in the variables). 
Conversely, any homogeneous implicit equation (or one that can be made homoge- 
neous by a change of coordinates) represents a cone. 
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FIGURE 4.37 

Top: a cone with vertex O and directrix C. Bottom left: a right circular cone. Bottom right: 
A frustum of the latter. 





If C is a simple closed curve, we also apply the word cone to the solid enclosed 
by the surface generated in this way (Figure 4.37, top). The volume contained be- 
tween P and the vertex O is 

V = \Ah, (4.16.1) 

where A is the area in the plane P enclosed by C and h is the distance from O and 
P (measured perpendicularly). 

The solid contained between P and a plane P' parallel to P (on the same side 
of the vertex) is called a frustum. It's volume is 

V = \h{A + A 1 + \fA~A 1 ) , (4. 16.2) 

where A and A 1 are the areas enclosed by the sections of the cone by P and P 1 (often 
called the bases of the frustum), and h is the distance between P and P'. 

The most important particular case of a cone is the right circular cone (often 
simply called a cone). If r is the radius of the base, h is the altitude, and I is the 
length between the vertex and a point on the base circle (Figure 4.37, bottom left), 
the following relationships apply: 

I = y/ r 2+h 2 , 

Lateral area = irrl = irr\/r 2 + h 2 , 
Total area = irr(l + r) = irr(r + \j r 2 + h 2 ), and 
Volume = i-7rr 2 /i. 

The implicit equation of this surface can be written x 2 + y 2 = z 2 ; see also Sec- 
tion 4.18. 
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For a. frustum of a right circular cone (Figure 4.37, bottom right), 



i = V(n -r 2 f + h\ 

Lateral area = ir(n + r2)l, 
Total area = ir(r\ + r\ + (r\ +r2)l), and 
Volume = |7r/i(rj + r\ + r\r%). 



4.17 SURFACES OF REVOLUTION: THE TORUS 



A surface of revolution is formed by the rotation of a planar curve C about an axis in 
the plane of the curve and not cutting the curve. The Pappus-Guldinus theorem says 



1. The area of the surface of revolution on a curve C is equal to the product of 
the length of C and the length of the path traced by the centroid of C (which 
is 2tt times the distance from this centroid to the axis of revolution). 

2. The volume bounded by the surface of revolution on a simple closed curve C 
is equal to the product of the area bounded by C and the length of the path 
traced by the centroid of the area bounded by C. 

When C is a circle, the surface obtained is a circular torus or torus of revolution 
(Figure 4.38). Let r be the radius of the revolving circle and let R be the distance 
from its center to the axis of rotation. The area of the torus is 4n 2 Rr, and its volume 
is 2ir 2 Rr 2 . 



that: 



FIGURE 4.38 

A torus of revolution. 






R 
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4.18 QUADRICS 

A surface defined by an algebraic equation of degree two is called a quadric. Spheres, 
circular cylinders, and circular cones are quadrics. By means of a rigid motion, any 
quadric can be transformed into a quadric having one of the following equations 
(where a,b,c^ 0): 

1. Real ellipsoid: x 2 /a 2 + y 2 /b 2 + z 2 /c 2 = 1 

2. Imaginary ellipsoid: x 2 /a 2 + y 2 /b 2 + z 2 /c 2 = — 1 

3. Hyperboloid of one sheet: x 2 /a 2 + y 2 jb 2 — z 2 /c 2 = 1 

4. Hyperboloid of two sheets: x 2 /a 2 +y 2 /b 2 — z 2 /c 2 = — 1 

5. Real quadric cone: x 2 /a 2 + y 2 jb 2 — z 2 /c 2 = 

6. Imaginary quadric cone: x 2 /a 2 + y 2 jb 2 + z 2 /c 2 = 

7. Elliptic paraboloid: x 2 /a 2 + y 2 jb 2 + 2z = 

8. Hyperbolic paraboloid: x 2 /a 2 — y 2 jb 2 + 2z = 

9. Real elliptic cylinder: x 2 /a 2 +y 2 /b 2 = 1 

10. Imaginary elliptic cylinder: x 2 /a 2 +y 2 /b 2 = —1 

11. Hyperbolic cylinder: x 2 /a 2 — y 2 /b 2 = 1 

12. Real intersecting planes: x 2 /a 2 - y 2 jb 2 = 

13. Imaginary intersecting planes: x 2 /a 2 + y 2 /b 2 = 

14. Parabolic cylinder: x 2 + 2y = 

15. Real parallel planes: x 2 = 1 

16. Imaginary parallel planes: x 2 = —1 

17. Coincident planes: x 2 = 

Surfaces with Equations 9-17 are cylinders over the plane curves of the same 
equation (Section 4.15). Equations 2, 6, 10, and 16 have no real solutions, so that 
they do not describe surfaces in real three-dimensional space. A surface with Equa- 
tion 5 can be regarded as a cone (Section 4.16) over a conic C (any ellipse, parabola, 
or hyperbola can be taken as the directrix; there is a two-parameter family of essen- 
tially distinct cones over it, determined by the position of the vertex with respect to 
C). The surfaces with Equations 1, 3, 4, 7, and 8 are shown in Figure 4.39. 

The surfaces with Equations 1-6 are central quadrics; in the form given, the 
center is at the origin. The quantities a,b,c are the semi-axes. 

The volume of the ellipsoid with semi-axes a, b, c is ^irabc. When two of the 
semi-axes are the same, we can also write the area of the ellipsoid in closed-form. 
Suppose b = c, so the ellipsoid x 2 /a 2 + (y 2 +z 2 )/b 2 = 1 is the surface of revolution 
obtained by rotating the ellipse x 2 /a 2 + y 2 jb 2 = 1 around the x-axis. Its area is 



„ , 9 2ira 2 b . Va 2 - b 2 „ , 9 ira 2 b , b + Vb 
2-Kb 2 + , sin = 2i:b 2 + , log 



sja 2 - b 2 a V& 2 - a 2 b-y/b 2 -a 2 ' 

(4.18.1) 

The two quantities are equal, but only one avoids complex numbers, depending on 
whether a > b or a < b. When a > b, we have a prolate spheroid, that is, an ellipse 
rotated around its major axis; when a < b we have an oblate spheroid, which is an 
ellipse rotated around its minor axis. 
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Given a general quadratic equation in three variables, 

ax 2 + by 2 + cz 2 + 2fyz + 2gzx + 2hxy + 2px + 2qy + 2rz + d 
one can determine the type of conic by consulting the table: 



0, (4.18.2) 



P3 


Pi 


A 


k signs 


K signs 


Type of quadric 


3 


4 


< 






Real ellipsoid 


3 


4 


> 


Same 




Imaginary ellipsoid 


3 


4 


> 


Opp 




Hyperboloid of one sheet 


3 


4 


< 


Opp 




Hyperboloid of two sheets 


3 


3 




Opp 




Real quadric cone 


3 


3 




Same 




Imaginary quadric cone 


2 


4 


< 


Same 




Elliptic paraboloid 


2 


4 


> 


Opp 




Hyperbolic paraboloid 


2 


3 




Same 


Opp 


Real elliptic cylinder 


2 


3 




Same 


Same 


Imaginary elliptic cylinder 


2 


3 




Opp 




Hyperbolic cylinder 


2 


2 




Opp 




Real intersecting planes 


2 


2 




Same 




Imaginary intersecting planes 


1 


3 








Parabolic cylinder 


1 


2 






Opp 


Real parallel planes 


1 


2 






Same 


Imaginary parallel planes 


1 


1 








Coincident planes 



The columns have the following meaning. Let 



h 
b 
f 



and E 



h 
b 
f 

q 



(4.18.3) 



Let p3 and p± be the ranks of e and E, and let A be the determinant of E. The 
column "fc signs" refers to the non-zero eigenvalues of e, that is, the roots of 

a — x h g 
h b-x f =0; (4.18.4) 
9 f c-x 

if all non-zero eigenvalues have the same sign, choose "same", otherwise "opposite". 
Similarly, "K signs" refers to the sign of the non-zero eigenvalues of E. 



4.18.1 SPHERES 

The set of points in space whose distance to a fixed point (the center) is a fixed 
number (the radius) is a sphere. A circle of radius r and center (xq, yo, zq) is defined 
by the equation 

(x-x ) 2 + (y-y ) 2 + (z-z ) 2 = r 2 , (4.18.5) 

or 

x 2 + y 2 + z 2 - 2xx - 2yy - 2zz + x\ + y 2 + z 2 - r 2 = 0. (4.18.6) 
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FIGURE 4.39 

The ve non-degenerate real quadrics. Top left: ellipsoid. Top right: hyperboloid of two 
sheets (one facing up and one facing down). Bottom left: elliptic paraboloid. Bottom middle: 
hyperboloid of one sheet. Bottom right: hyperbolic paraboloid. 




Conversely, an equation of the form 

x 2 + y 2 + z 2 + 2dx + 2ey + 2fz + g = (4.18.7) 
defines a sphere if d 2 + e 2 + f 2 > g; the center is (— d, — e, — /) and the radius is 
Vd 2 + e 2 + p - g. 

1. Four points not in the same plane determine a unique sphere. If the points 
have coordinates {x\,yi,z{), ixi^yi^z-i), (2:3, 2/3,23), and (0:4, x±, 24), the 
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FIGURE 4.40 

Left: a spherical cap. Middle: a spherical zone (of two bases). Right: a spherical segment. 




equation of the sphere is 



x 2 


+ y 2 + z 2 


X 


y 


z 


xl 


+ v\ + 4 


Xl 


yi 


Z\ 


x\ 


+ vl + 4 


X2 


yi 




x\ 


+ vl + 4 


X3 




zz 


X \ 


+ yl + 4 


X4 


y\ 


Zi 



2. Given two points Pi = (x\,yi,zi) and P 2 = (^2,2/2,^2), there is a unique 
sphere whose diameter is P\Pi\ its equation is 

(x - Xl )(x - x 2 ) + (y- yi)(y - y 2 ) + (z - zi)(z - z 2 ) = 0. (4.18.9) 

3. The area of a sphere of radius r is Aitr 2 , and the volume is |-7rr 3 . 

4. The area of a spherical polygon (that is, of a polygon on the sphere whose 
sides are arcs of great circles) is 

n 

S = (^Oi- (n-2)T^r 2 , (4.18.10) 

i=l 

where r is the radius of the sphere, n is the number of vertices, and #j are 
the internal angles of the polygons in radians. In particular, the sum of the 
angles of a spherical triangle is always greater than 7r = 180°, and the excess 
is proportional to the area. 



4.18.1.1 Spherical cap 

Let the radius be r (Figure 4.40, left). The area of the curved region is 2irrh = Trp 2 . 
The volume of the cap is |7r/i 2 (3r — h) = ^irh(3a 2 + h 2 ). 

4.1 8.1 .2 Spherical zone (of two bases) 

Let the radius be r (Figure 4.40, middle). The area of the curved region (called a 
spherical zone) is 2irrh. The volume of the zone is ^Trh(3a 2 + 3b 2 + h 2 ). 
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4.18.1.3 Spherical segment and lune 

Let the radius be r (Figure 4.40, right). The area of the curved region (called a 
spherical segment or lune) is 2r 2 <9, the angle being measured in radians. The volume 
of the segment is §?' 3 #. 



4.18.1.4 Volume and area of spheres 

If the volume of an n-dimensional sphere of radius r is V n (r) and its surface area is 
S n (r), then 

27rr 2 2W 2 r" W 2 r™ 

V n (r) = — V„_ a (r) 



n n 

S n (r) = -V n (r) = -f [V n (r) 
r ar 



r (a) (2)' (4.18.11) 



Hence, the area of a circle is V2 = itr 2 « 3.1416r 2 , the volume of a 3-dimensional 
sphere is V3 = |-7rr 3 rj 4.1888r 3 , the volume of a 4-dimensional sphere is V4 = 
\ / K 2 r i « 4.9348r 4 , the circumference of a circle is 52 = 2-jrr, and the surface area 
of a sphere is 53 = 47rr 2 . 



For large values of n 



n -(n+l)/2 

V n (r) « = (27re)"/ 2 r". (4.18.12) 



4.19 SPHERICAL GEOMETRY & TRIGONOMETRY 

The angles in a spherical triangle do not have to add up to 180 degrees. It is possible 
for a spherical triangle to have 3 right angles. 



4.19.1 RIGHT SPHERICAL TRIANGLES 

Let a, b, and c be the sides of a right spherical triangle with opposite angles A, B, 
and C, respectively, where each side is measured by the angle subtended at the center 
of the sphere. Assume that C = ir/2 = 90° (see Figure 4.41, left). Then, 

sin a = tan b cot B = sin A sin c, cos A = tan b cot c = cos a sin B, 
sin b = tan a cot A = sin B sin c, cos B = tan a cot c = cos b sin A, 
cos c = cos A cot B = cos a cos 6. 



4.1 9.1 .1 Napier's rules of circular parts 

Arrange the five quantities a, b, co-A (this is the complement of ^4), co-c, co-B 
of a right spherical triangle with right angle at C, in cyclic order as pictured in 
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FIGURE 4.41 

Right spherical triangle (left) and diagram for Napier's rule (right). 




Figure 4.41, right. If any one of these quantities is designated a middle part, then 
two of the other parts are adjacent to it, and the remaining two parts are opposite to 
it. The formulae above for a right spherical triangle may be recalled by the following 
two rules: 

1 . The sine of any middle part is equal to the product of the tangents of the two 
adjacent parts. 

2. The sine of any middle part is equal to the product of the cosines of the two 
opposite parts. 



4.19.1.2 Rules for determining quadrant 

1. A leg and the angle opposite to it are always of the same quadrant. 

2. If the hypotenuse is less than 90°, the legs are of the same quadrant. 

3. If the hypotenuse is greater than 90°, the legs are of unlike quadrants. 



4.19.2 OBLIQUE SPHERICAL TRIANGLES 

In the following: 

• a,b, c represent the sides of any spherical triangle. 

• A, B,C represent the corresponding opposite angles. 

• a', b', c', A 1 , B', C are the corresponding parts of the polar triangle. 

• s = (a + b + c)/2. 

• S = (A + B + C)/2. 

• A is the area of spherical triangle. 

• E is the spherical excess of the triangle. 

• R is the radius of the sphere upon which the triangle lies. 
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0° < a + b + c < 360°, 180° < A + B + C < 540 

E = A + B + C- 180°, A = irR 2 E/l80. 

l / s i~! ~ i~! ~ l, ~ 

tan -£< = 4 /tan - tan — (s — a) tan — (s — o) tan - Is — c). 
4 V 2 2 2 2 

A = 180° - a', B = 180° - 6', C = 180° - c' 

a =180° -A 1 , 6 = 180° -5', c = 180° - C 



4.19.2.1 Spherical law of sines 

sin a sin b sin c 
sin A sin B sin C 

4.19.2.2 Spherical law of cosines for sides 

cos a = cos b cos c + sin b sin c cos ^4, 
cos b = cos c cos a + sine sin a cos B, 
cos c = cos a cos 6 + sin a sin 6 cos C. 



4.19.2.3 Spherical law of cosines for angles 

cos A = — cos B cos C + sin B sin C cos a, 
cos B = — cos C cos A + sin C sin A cos 6, 
cos C = — cos A cos B + sin A sin B cos c. 

4.19.2.4 Spherical law of tangents 

tan \{B - C) _ tan \{b - c) 
tan \{B + C)~ tan \{b + c) ' 
tani(C — A) tani(c — a) 
t<m\(C + A) tani(c + a)' 
tan \{A - B) _ tan \{a - b) 
t<m\(A + B) tan | (a + 6)' 

4.19.2.5 Spherical half angle formulae 

^ „ , o , , 9 sin(s — a) sin(s — b) sin(s — c) _ 
Define k = (tanr) 2 = — -. Then 

sms 
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( A 


tan | 


V2 




f B 


tan | 






fC 


tan 






v 2 



k 



sm(s — a) ' 

k_ 

sin(s — b) ' 
k 

sin(s — c) 



(4.19.1) 



4.19.2.6 Spherical half side formulae 

cos S 

Define K 2 = (tani?) 2 = — — — — — — . Then 

v ' cos(S - A) cos(S - B) cos(S - C) 

tan(a/2) = K cos(S - A), 

tan(6/2) = K cos(S - B), (4.19.2) 
tan(c/2) = ^cos(S-C). 



4.19.2.7 Gauss's formulae 

sini(a-b) sin^(A-B) cos±(a-6) sin \(A + B) 
sin cos ^6 cos cos |6 

sin i (a + 6) cos | (.4 — B) cos | (a + 6) cos | ( A + B) 
sin \c sin cos sin \C 



4.19.2.8 Napier's analogs 



s\n\{A-B) tsn\{a-b) s\n\{a-b) t&n\{A-B) 



sm\(A + B) tan ic sin|(a + 6) cot 

cosi(A-B) tan±(a + 6) cos±(a-6) t<m\{A + B) 

cos\(A + B) tan ic cos|(a + 6) cot 



4.19.2.9 Rules for determining quadrant 

1. If A> B > C, then a > b > c. 

2. A side (angle) which differs by more than 90 ° from another side (angle) is in 
the same quadrant as its opposite angle (side). 

3. Half the sum of any two sides and half the sum of the opposite angles are in 
the same quadrant. 
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4.19.2.10 Summary of solution of oblique spherical triangles 



Given 


Solution 


v^necK 


Three sides 


Half-angle formulae 


Law of sines 


Three angles 


Half-side formulae 


Law of sines 


Iwo sides and 
included angle 


INapier s analogies (to tind sum and difference 
of unknown angles); then law of sines (to find 
remaining side). 


Gauss's 
formulae 


i .... i . j 

Iwo angles and 

included side 


Napier's analogies (to find sum and difference 
of unknown sides); then law of sines (to find 
remaining angle). 


Gauss's 
formulae 


Two sides and 
an opposite 
angle 


Law of sines (to find an angle); then Napier's 
analogies (to find remaining angle and side). 
Note the number of solutions. 


Gauss's 
formulae 


Two angles and 
an opposite side 


Law of sines (to find a side); then Napier's 
analogies (to find remaining side and angle). 
Note the number of solutions. 


Gauss's 
formulae 



4.1 9.2.1 1 Haversine formulae 

1 — cos a 2 a 
hav a = = sin — 



hav A 



hav(6 — c) + sin b sin c hav A. 
sin(s — b) sin(s — c) 

sin b sin c 
hav a — hav(6 — c) 

sin b sin c 

hav[180° — (B + C)} + sin B sin C hav a. 



4.19.2.12 Finding the distance between two points on the earth 

To find the distance between two points on the surface of a spherical earth, let point 
Pi have a (latitude, longitude) of {4>\,Q\) and point P 2 have a (latitude, longitude) 
of ((j> 2 ,6 2 ). Two different computational methods are as follows: 

1 . Let A be the North pole and let B and C be the points Pi and P 2 . Then the 
spherical law of cosines for sides gives the central angle, a, subtended by the 
desired distance: 

cos(a) = cos(6) cos(c) + sin(fo) sin(c) cos(A) 

where the angle A is the difference in longitudes, and b and c are the angles of 
the points from the pole (i.e., 90°— latitude). Scale by J? e (the radius of the 
earth) to get the desired distance. 

2. In (x, y, z) space (with +z being the North pole) points Pi and P 2 are repre- 
sented as vectors from the center of the earth in spherical coordinates: 

Vi = [R® cos(^i) cos(0i) i?© cos(^i) sin(0i) i? e sin(^i)] , ^ ^ 
v 2 = [R & cos(^ 2 ) cos(0 2 ) Rq cos(^ 2 ) sin(0 2 ) i?© sin(^ 2 )] . 
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The angle between these vectors, a, is given by 

Vi • V2 Vi • V2 

cos ct = - — - — - = —J — = cos(fa) cos(fa) cos(#i - 62) + sm(fa) sm(^ 2 ) 
|Vi||v 2 | H @ 

=2tan " i v / S 

where b = sin 2 ^ 1 ~^ 2 j + cos(fa) cos(<f>2) sin 2 ( gl ~ e2 ). (The formula using 
b is more accurate numerically when P\ and P 2 are close.) The great circle 
distance between Pi and P 2 is then R®a. 

EXAMPLE The angle between fk ew Y rk with (fa = 40.78°, 6 X = 73.97°) and ffeeijing 
with (fa = 39.93°, 62 = 243.58°) is a = 98.8°. Using R @ = 6367 the great circle 
distance between New York and Beijing is about 1 1,000 km. 



4.20 DIFFERENTIAL GEOMETRY 



4.20.1 CURVES 
4.20.1.1 De nitions 

1. A regular parametric representation of class C k , k > 1, is a vector valued 
function f : I — > M 3 , where I C IK is an interval that satisfies (i) f is of class 
C k (i.e., has continuous k th order derivatives), and (ii) f'(t) ^ 0, for all tel. 
In terms of a standard basis of K 3 , we write x = f(t) = (fi(t), f 2(f), f 3(f)), 
where the real valued functions i = 1,2,3 are the component functions of f. 

2. An allowable change of parameter of class C k is any C k function <j> : J — > 7, 
where J is an interval and fa J) C /, that satisfies fa(r) ^ 0, for all r € J. 

3. A C k regular parametric representation f is equivalent toaC* regular para- 
metric representation g if and only if an allowable change of parameter <f> exists 
so that fa\l g ) = I f , and g(r) = f(^(r)), for all r G 7 fl . 

4. A regular curve C of class C k is an equivalence class of C k regular parametric 
representation under the equivalence relation on the set of regular parametric 
representations defined above. 

5. The arc length of any regular curve C defined by the regular parametric repre- 
sentation f, with If = [a, b], is defined by 

L= f \?(u)\ du. (4.20.1) 

J a 

An arc length parameter along C is defined by 

s = a(t) = ± f \f'(u) \ du. (4.20.2) 
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The choice of sign is arbitrary and c is any number in If . 



6. A natural representation of class C k of the regular curve defined by the regular 
parametric representation f is defined by g(s) = f(a _1 (s)), for all s € [0, L]. 

7. A property of a regular curve C is any property of a regular parametric rep- 
resentation representing C which is invariant under any allowable change of 
parameter. 

8. Let g be a natural representation of a regular curve C. The following quantities 
may be defined at each point x = g(s) of C: 



Binormal line 
Curvature 
Curvature vector 
Moving trihedron 
Normal plane 
Osculating plane 
Osculating sphere 



Principal normal line 
Principal normal unit 

vector 
Radius of curvature 
Rectifying plane 
Tangent line 
Torsion 

Unit binormal vector 
Unit tangent vector 



y = Ab(s) + X 

k(s) = n(s) • k(s) 

k(a) = i(s) 

{t( s ),n( s ),b( S )} 

(y - x) • t(a) = 

(y - x) • b(s-) = 

(y — c) • (y — c) = r 2 where 

c = x + p(s)n(s)-(k(s)/( K 2 (s)r(s)))b(s) 

and r 2 = p 2 (s) + k 2 (s) / (k 4 (s)t 2 (s)) 

y = An(s) + x 

n(s) = ±k(s)/|k(s)|,fork(s) ^ defined to be 

continuous along C 
p(s) = 1/ |k(s)|, when k(s) ^ 
(y - x) • n(a) = 
y = At(a) + x 
r(s) = — n(s) • b(s) 
b(s) = t(s) x n(s) 

t(a) = g(a) with (g(a) = f ) 



4.20.1.2 Results 

The arc length L and the arc length parameter s of any regular parametric represen- 
tation f are invariant under any allowable change of parameter. Thus, L is a property 
of the regular curve C defined by f. 

The arc length parameter satisfies = a'(t) = ±\t(t)\, which implies that 
|f(s) | = 1, if and only if t is an arc length parameter. Thus, arc length parameters 
are uniquely determined up to the transformation s^s = ±s + s o, where s is an y 
constant. 

The curvature, torsion, tangent line, normal plane, principal normal line, recti- 
fying plane, binormal line, and osculating plane are properties of the regular curve 
C defined by any regular parametric representation f . 

If x = f(t) is any regular representation of a regular curve C, the following 
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results hold at point f(i) of C: 

. , |x" x x' 



x' • (x" x x'") 



(4.20.3) 



|X'| |X' X x"| 

The vectors of the moving trihedron satisfy the Serret-Frenet equations 

t = «n, h = -Kt + rb, b = -rn. (4.20.4) 
For any plane curve represented parametrically by x = f(t) = (t, f(t),0), 



d^x 
U 1 



(l+(f) 2 ) 



3/2 ' 



(4.20.5) 



Expressions for the curvature vector and curvature of a plane curve corresponding to 
different representations are given in the following table: 



Representation 



Curvature vector k 



Curvature, \k\ = p 1 



x = f(t), 

y = g(t) 



(xy - yx) 
(x 2 + y 2 ) 2 



(-y,x) 



\xy -yx\ 
(x 2 +y 2 ) 3 / 2 



y = f(x) 



y" 



(l + y' 2 ) 2 



(-i/M) 



(l + y' 2 ) 3 / 2 



1(0) 



(r 2 +2r' -rr")(-r sin ( 



r cos ( 



( r 2 _|_ r /2^2 j- cos 6 — r sin 6) 



( r 2 +r <2p/ 2 



The equation of the osculating circle of a plane curve is given by 

(y-c) • (y-c) = p 2 , 
where c = x + p 2 k is the center of curvature. 



(4.20.6) 



THEOREM 4.20.1 (Fundamental existence and uniqueness theorem) 

Let k(s) and r(s) be any continuous functions de ne dfor all s € [a, b]. Then there 
exists, up to a congruence, a unique space curve C for which k is the curvature 
function, r is the torsion function, and s an arc length parameter along C. 



4.20.1.3 Example 

A regular parametric representation of the circular helix is given by x = f(t) = 
(a cos t, a sin t, bt), for all t £ IK, where a > and b ^ are constant. By successive 
differentiation, 

x' = (— asini, a cost, b), 

x" = (-a cos*, -asini.O), (4.20.7) 
x'" = ( asini, — acosi,0), 
so that |f = |x'| = \/a 2 + b 2 . Hence, 

1. Arc length parameter, s = a(t) = t(a 2 + b' 2 )^ 

2. Curvature vector: k= f - = f-^ = (a 2 + b 2 )~ l (-a cost, -a sini, 0) 
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3. Curvature: k = |k| = a(a 2 + b 2 ) 1 

4. Principal normal unit vector: n = k/ |k| = (— cosi, — sini, 0) 

5. Unit tangent vector: t = jpj = (a 2 + fr 2 )" (— a sini, acosi, 6) 

6. Unit binomial vector: 

b = t x n = (a 2 + b 2 )~i (b sin t,b cost, a) 

b=vv = Ha 2 + b 2 )' 1 (cost, sin t,0) 
as at 

7. Torsion: r = -n t> = 6(a 2 + 6 2 )" 1 

The values of |k| and r can be verified using the formulae in (4.20.3). The sign of 
(the invariant) r determines whether the helix is right handed, r > 0, or left handed, 
r < 0. 



4.20.2 SURFACES 
4.20.2.1 Definitions 

1. A coordinate patch of class C k ,k > 1 on a surface S C IR 3 is a vector valued 
function / : U — > S, where U C IR 2 is an open set, that satisfies (i) f is 
class C k on U, (ii) ^(u,v) x ^(u,v) ^ 0, for all (u,v) G U, and (hi) f is 
one-to-one and bi-continuous on U. 

2. In terms of a standard basis of E 3 we write x = f(u, v) = (/i (u, v), fi (u,v), 
fz(u,v)), where the real valued functions {/i,/2,/s} are the component func- 



tions of f. The notation Xi = x u = J^, x 2 = x^ = u 1 = u,u 2 = v, is 
frequently used. 



3. A Monge patch is a coordinate patch where f has the form f(u,v) = 
(u, v, f(u, v)), where / is a real valued function of class C k . 

4. The u-parameter curves v = vo on S are the images of the lines v = vo in U. 
They are parametric ally represented by x = {(u, vq). The v-parameter curves 
u = uo are defined similarly. 

5. An allowable parameter transformation of class C k is a one-to-one function 
<j> : U — > V, where U, V C IR 2 are open, that satisfies 



det 



^ 0, (4.20.8) 



for all (u,v) £ U, where the real valued functions, (f) 1 and (f> 2 , defined by 
<f>(u,v) = ((f) 1 (u,v), <f> 2 (u,v)) are the component functions of <f>. One may 
also write the parameter transformation as u 1 = (j) 1 (u 1 ,u 2 ), u 2 = ^< 2 (u 1 ,u 2 ). 

6. A local property of surface S is any property of a coordinate patch that is 
invariant under any allowable parameter transformation. 

7. Let f define a coordinate patch on a surface S. The following quantities may 
be defined at each point x = f(u, v) on the patch: 
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Asymptotic direction 
Asymptotic line 

Dupin's indicatrix 

Elliptic point 

First fundamental form 



First fundamental metric 

coef cients 
Fundamental differential 



Gaussian curvature 

Geodesic curvature vector of 
curve C on S through x 



Geodesic on S 
Hyperbolic point 
Line of curvature 

Mean curvature 

Normal curvature in the 
du : dv direction 

Normal curvature vector of 
curve C on S through x 

Normal line 
Normal vector 
Parabolic point 
Planar point 
Principal curvatures 
Principal directions 

Second fundamental form 



Second fundamental metric 
coef cients 



A direction du : dv for which k„ = 
A curve on S whose tangent line at each point 
coincides with an asymptotic direction 

ex\ + 2fx\X2 + gx\ = ±1 
eg - f > 

I = dx ■ dx = g a p (u, v) du a du 13 

= E(u, v) du 2 + 2F(u, v) du dv + G(u, v) dv 2 

E(u, v) = 0ii (u, v) = Xi • xi 
F(u,v) = g 12 (u,v) = xi • x 2 
G(u,v) = g 2 2 (u,v) = x 2 • x 2 
dx = x a du a =x u du + x v dv (a repeated upper 
and lower index signifies a summation over the 
range a = 1, 2) 

/ 2 



K 
k„ 



Kl«2 



eg 

EG - F 2 



k - (k n)n = [il a + T^u^u^Xa where 



denote the Christoffel symbols of the 
second kind for the metric g a p, defined in 
Section 5. 10 

A curve on S which satisfies k fl = at each point 

eg - P < 

A curve on S whose tangent line at each point 
coincides with a principal direction 

«i +k 2 gE + eG- 2fF 



H 



2(EG-F 2 ) 



k„ = (k n)n 

y = A^V + x 

eg - f 2 = not all of e, /, g = 
e = / = g = 

The extreme values k i and k 2 of K n 
The perpendicular directions du : dv in which k n 
attains its extreme values 

II = —dx ■ dn = b a p(u, v) du a du 13 

= e(u 7 v) du 2 + 2/(m, v) du dv + g(u, v) dv 2 

e(u,v) = bn(u,v) = xn • n 
f(u,v) = bu(u,v) = X12 • n 
,g(u,v) = b 2 2(u,v) = x 22 • n 
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Tangent plane (y — x) • M = 0, or y = x + \x u + px v 

Unit normal vector N 



\x u x x v I 

Umbilical point K n = constant for all directions du : dv 



4.20.2.2 Results 

1. The tangent plane, normal line, first fundamental form, second fundamental 
form, and all derived quantities thereof are local properties of any surface S. 

2. The transformation laws for the first and second fundamental metric coeffi- 
cients under any allowable parameter transformation are given respectively by 

du 1 du s , ~ , du 1 du s 

B ^ =B ^'a^W and b ^ = b ^'a^W (4 - m9) 

Thus g a p and b a p are the components of type (0, 2) tensors. 

3. I > for all directions du : dv; I = if and only if du = dv = 0. 

4. The angle 9 between two tangent lines to 5 at x = f(u,v) defined by the 
directions du : dv and Su : Sv is given by 

g a p d^Su 13 

cosO = — — . (4.20.10) 

(g a p du a dvP)v (g a p8u a 8uP)* 

The angle between the u-parameter curves and the ^-parameter curves is given 
by cos 6 = F(u,v)/(E(u,v)G(u,v))?. The u-parameter and ^-parameter 
curves are orthogonal if and only if F(u, v) =0. 

5. The arc length of a curve C on S, defined by x = f(u 1 (t), u 2 (t)), with a < 
t < b, is given by 

L= t ^g aP {u 1 {t),u l {t))u a uPdt (4.20.11) 

J a 

^/E(u(t),v(t))u 2 + 2F(u(t),v(t))iiv + G(u(t),v(t))v 2 dt. 



J a 



6. The area of S = f(U) is given by 

A = jj y/detigapiu^u^du 1 du 2 

(4.20.12) 

y/E(u,v)G(u,v) - F 2 (u,v) du dv. 



7. The principal curvatures are the roots of the characteristic equation, det(b a p — 
\g a p) = 0, which may be written as A 2 — b a pg al3 X + b/g = 0, where g a/3 is 
the inverse of g a p, b = det(b a p), and g = det(g a p). The expanded form of 
the characteristic equation is 

(EG - F 2 )\ 2 - (eG - 2fF + gE)X + eg -f 2 =0. (4.20.13) 
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8. The principal directions du : dv are obtained by solving the homogeneous 
equation, 

b la g 2 p du a du 13 - b 2a gip du a dvP = 0, (4.20.14) 

or 

(eF - fE) du 1 + (eG - gE) du dv + (fG - gF) dv 2 = 0. (4.20. 15) 

9. Rodrigues formula: du : dv is a principal direction with principal curvature k 
if, and only if, dN + k dx = 0. 

10. A point x = f(u,v) on S is an umbilical point if and only if there exists a 
constant k such that b a p(u, v) = kg a p(u, v). 

1 1 . The principal directions at x are orthogonal if x is not an umbilical point. 

12. The u- and v-parameter curves at any non-umbilical point x are tangent to 
the principal directions if and only if f(u,v) = F(u,v) = 0. If f defines a 
coordinate patch without umbilical points, the u- and w-parameter curves are 
lines of curvature if and only if / = F = 0. 

13. If / = F = Oona coordinate patch, the principal curvatures are given by 
Ki = e/E, K2 = g/G. It follows that the Gaussian and mean curvatures have 
the forms 

* = §}• H = 5(l + D- < 4 ' 2tu6 > 

14. The Gauss equation: x a p = rZgX 7 -I- b a pn. 

15. The Weingarten equation: n a = — ba^g^x^. 

16. The Gauss-Mainardi-Codazzi equations: b a pb^s ~ b a ~/bps = Rda^, b a $^ — 
b a7 ,{3 + ^apbg-y — Taybsp = 0, where Rs a p 7 denotes the Riemann curvature 
tensor defined in Section 5. 10.3. 



THEOREM 4.20.2 (Gauss's theorema egregium) 

The Gaussian curvature K depends only on the components of the r st fundamental 
metric g a p and their derivatives. 

THEOREM 4.20.3 (Fundamental theorem of surface theory) 

If g a p and b a p are suf ciently differentiable functions of u and v which satisfy the 
Gauss-Mainardi-Codazzi equations, det(g a p) > 0, g\\ > 0, and g^2 > 0, then a 
surface exists with I = g a p du a du 13 and II = b a p du a du 13 as its r st and second 
fundamental forms. This surface is unique up to a congruence. 
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4.20.2.3 Example: paraboloid of revolution 

A Monge patch for a paraboloid of revolution is given by x = f(u, v) = (u,v,u 2 + 
v 2 ), for all (u,v) € U = M 2 . By successive differentiation one obtains x u = 
(1, 0, 2u), x v = (0, 1, 2v), x uu = (0,0,2), x uv = (0, 0, 0), and x vv = (0, 0, 2). 

1. Unit normal vector, n = (1 + 4u 2 + 4v 2 )~?(-2u, -2v, 1). 

2. First fundamental coef cients: E(u,v) = gu(u,v) = 1 + 4u 2 , F(u,v) = 
gr 2 (u,v) = 4uv, G(u,v) = g 22 (u,v) = 1 + 4v 2 . 

3. First fundamental form: I = (l + 4u 2 ) du 2 +8uv du dv + (1 +4v 2 ) dv 2 . Since 
F(u, v) = => u = or u = 0, it follows that the u-parameter curve v = 
is orthogonal to any v-parameter curve, and the ^-parameter curve u = is 
orthogonal to any u-parameter curve. Otherwise the u- and ^-parameter curves 
are not orthogonal. 

4. Second fundamental coef cients: e(u,v) = b\\(u,v) = 2(1 + 4u 2 +4v 2 )~i, 
f(u,v) = bi 2 (u,v) = 0, g(u,v) = b 2 2(u,v) = 2(1 + 4u 2 + 4v 2 )~? . 

5. Second fundamental form: II = 2(1 + 4u 2 + 4v 2 )~i(du 2 + dv 2 ). 

6. Classi cation of points: e(u,v)g(u,v) = 4(l+4u 2 +4v 2 ) > implies that all 
points on S are elliptic points. The point (0, 0, 0) is the only umbilical point. 

7. Equation for the principal directions: uv du 2 + (v 2 — u 2 ) du dv + uv dv 2 = 
factors to read (udu + v dv)(v du — u dv) = 0. 

8. Lines of curvature: Integrate the differential equations, u dv + v dv = 0, and 
v du — v du = 0, to obtain, respectively, the equations of the lines of curvature, 
u 2 + v 2 = r 2 , and u/v = cot 8, where r and 9 are constant. 

9. Characteristic equation: (1 + 4u 2 + 4v 2 )X 2 - 4(1 + 2u 2 + 2v 2 ) (1 + 4u 2 + 
4v 2 )~?\ + 4(1 + 4u 2 + 4V 2 )- 1 = 0. 

10. Principal curvatures: m = 2(1 + 4u 2 +4v 2 )~^, k 2 = 2(1 + 4u 2 + 4v 2 )~i . 
The paraboloid of revolution may also be represented by x = f (r, 6) = (r cos 0, 
r sin 6, r 2 ). In this representation the r- and ^-parameter curves are lines of 
curvature. 

11. Gaussian curvature: K = 4(1 + 4u 2 + 4v 2 )~ 2 . 

12. Mean curvature: H = 2(1 + 2u 2 + 2v 2 )(l + 4u 2 + 4v 2 )~i . 
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4.21 ANGLE CONVERSION 



Degrees 


Radians 




Minutes 


Radians 


1° 


0.01745 33 




1 


0.00029 089 


2° 


0.03490 66 




2 


r\ AAACO 1 TO 

0.00058 178 


3° 


0.05235 99 




3 


0.00087 266 


A° 


U.WO70I J)Z 




A' 


W.UUl ID J)JJ> 


5° 


0.08726 65 




5' 


0.00145 444 


6° 


0.10471 98 




6' 


0.00174 533 


7° 


0.12217 30 




7' 


0.00203 622 


8° 


0.13962 63 




8' 


0.00232 711 


9° 


0.15707 96 




9' 


0.00261 799 


10° 


0.17453 29 




10' 


0.00290 888 



Seconds 


Radians 


1 


0.00000 4848 1 


2 


0.00000 96963 


3 


r\ r\r\r\r\ 1 a c a a a 

0.00001 45444 


A" 




5" 


0.00002 42407 


6" 


0.00002 90888 


7" 


0.00003 39370 


8" 


0.00003 87851 


9" 


0.00004 36332 


10" 


0.00004 84814 



Rad. 


Deg. 


Min. 


Sec. 


Deg. 


1 


57° 


17' 


44.8" 


57.2958 


2 


114° 


35' 


29.6" 


114.5916 


3 


171° 


53' 


14.4" 


171.8873 


4 


229° 


10' 


59.2" 


229.1831 


5 


286° 


28' 


44.0" 


286.4789 


6 


343° 


46' 


28.8" 


343.7747 


7 


401° 


4' 


13.6" 


401.0705 


8 


458° 


21' 


58.4" 


458.3662 


9 


515° 


39' 


43.3" 


515.6620 



Rad. 


Deg. 


Min. 


Sec. 


Deg. 


0.1 


5° 


43' 


46.5" 


5.7296 


0.2 


11° 


27' 


33.0" 


11.4592 


0.3 


17° 


11' 


19.4" 


17.1887 


0.4 


22° 


55' 


5.9" 


22.9183 


0.5 


28° 


38' 


52.4" 


28.6479 


0.6 


34° 


22' 


38.9" 


34.3775 


0.7 


40° 


6' 


25.4" 


40.1070 


0.8 


45° 


50' 


11.8" 


45.8366 


0.9 


51° 


33' 


58.3" 


51.5662 



Rad. 


Deg. 


Min. 


Sec. 


Deg. 


Rad. 


Deg. 


Min. 


Sec. 


Deg. 


0.01 


0° 


34' 


22.6" 


0.5730 


0.001 


0° 


3' 


26.3" 


0.0573 


0.02 


1° 


8' 


45.3" 


1.1459 


0.002 


0° 


6' 


52.5" 


0.1146 


0.03 


1° 


43' 


7.9" 


1.7189 


0.003 


0° 


10' 


18.8" 


0.1719 


0.04 


2° 


17' 


30.6" 


2.2918 


0.004 


0° 


13' 


45.1" 


0.2292 


0.05 


2° 


51' 


53.2" 


2.8648 


0.005 


0° 


17' 


11.3" 


0.2865 


0.06 


3° 


26' 


15.9" 


3.4377 


0.006 


0° 


20' 


37.6" 


0.3438 


0.07 


4° 


0' 


38.5" 


4.0107 


0.007 


0° 


24' 


3.9" 


0.4011 


0.08 


4° 


35' 


1.2" 


4.5837 


0.008 


0° 


27' 


30.1" 


0.4584 


0.09 


5° 


9' 


23.8" 


5.1566 


0.009 


0° 


30' 


56.4" 


0.5157 
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4.22 KNOTS UP TO EIGHT CROSSINGS 



n 


34567 8 9 10 11 


Number of knots 
with n crossings 


1 1 2 3 7 21 49 165 552 




817 8i 8 819 8 20 «21 



Image by Charlie Gunn and David Broman. Copyright The Geometry Center, Uni- 
versity of Minnesota. With permission. 
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3.1 SYMBOLIC LOGIC 



3.1.1 PROPOSITIONAL CALCULUS 

Prepositional calculus is the study of statements: how they are combined and how 
to determine their truth. Statements (or propositions) are combined by means of 
connectives such as and (A), or (V), not (-1, or sometimes ~), implies (—>•), and ;/ 
and only if (i — >). Propositions are denoted by letters {p, q,r,. . .}. For example, 
if p is the statement "x = 3", and q the statement "y = 4", then pV-ig would be 
interpreted as "x = 3 or y ^ 4". To determine the truth of a statement, truth tables 
are used. Using T (for true) and F (for false), the truth tables for these connectives 
are as follows: 



p 


q 


pAq 


pV q 


P -> Q 


p i — > q 


P 


-ip 


T 


T 


T 


T 


T 


T 


T 


F 


T 


F 


F 


T 


F 


F 


F 


T 


F 


T 


F 


T 


T 


F 






F 


F 


F 


F 


T 


T 







The proposition p — > q can be read "If p then q" or, less often, "q if p". The 
table shows that "p V g" is an inclusive or because it is true even when p and q are 
both true. Thus, the statement "I'm watching TV or Fm doing homework" is a true 
statement if the narrator happens to be both watching TV and doing homework. Note 
that p — > q is false only when p is true and q is false. Thus, a false statement implies 
any statement and a true statement is implied by any statement. 



3.1.2 TAUTOLOGIES 

A statement such as (p — > (q A r)) V ->p is a compound statement composed of 
the atomic propositions p, q, and r. The letters P, Q, and R are used to designate 
compound statements. A tautology is a compound statement which always is true, 
regardless of the truth values of the atomic statements used to de ne it. For example, 
a simple tautology is (— i— ij>) < — > p. Tautologies are logical truths. Some examples 
are as follows: 

Law of the excluded middle p V ->p 

De Morgan's laws ->(p V q) < — > (->p A -iq) 

-•(p A q) < — > (-ip V -iqf) 

Modus ponens (p A (p — > q)) — > q 

Contrapositive law (p — > q) < — > (~<q — > ->p) 

Reductio ad absurdum (-ip — > p) — > p 

Elimination of cases ((p V g) A ->p) — > g 

Transitivity of implication ((p — > g) A (g — > r)) — > (p — > r) 

Proof by cases ((p — > </) A (-ip — > g)) — > g 
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Idempotent laws p A p < — > p; pV p < — > p 
Commutative laws (p A q) i — > (q A p) ; (pV q) i — > (q V p) 
Associative laws (p A (q A r)) i — > ((pAq)Ar) 
(pV (qr V r)) < — >■ ((p V g) V r) 



3.1 .3 TRUTH TABLES AS FUNCTIONS 

If we assign the value 1 to T, and to F, then the truth table for p A q is simply the 
value pq. This can be done with all the connectives as follows: 



Connective 


Arithmetic function 


pAq 


pq 


p\/ q 


p + q-pq 


H q 


1 - p + pq 


p < — > q 


1 - p - q + 2pq 




1-p 



These formulae may be used to verify tautologies, because, from this point of view, 
a tautology is a function whose value is identically 1. In using them, it is useful to 
remember that pp = p 2 = p, since p = or p = 1. 



3.1 .4 RULES OF INFERENCE 

A rule of inference in propositional calculus is a method of arriving at a valid (true) 
conclusion, given certain statements, assumed to be true, which are called the hy- 
potheses. For example, suppose that P and Q are compound statements. Then if P 
and P — > Q are true, then Q must necessarily be true. This follows from the modus 
ponens tautology in the above list of tautologies. We write this rule of inference 
P, P — > Q => Q. It is also classically written 

P 

P^Q 



Q 

Some examples of rules of inferences follow, all derived from the above list of 
tautologies: 

Modus ponens P, P -> Q Q 

Contrapositive P ->• Q => -<Q -> -iP 

Modus tollens P -5- Q,~^Q => ~P 

Transitivity P^Q,Q^R=>P^-R 
Elimination of cases PV Q, -P Q 
"And" usage P AQ => P,Q 
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3.1.5 DEDUCTIONS 



A deduction from hypotheses is a list of statements, each one of which is either one of 
the hypotheses, a tautology, or follows from previous statements in the list by a valid 
rule of inference. It follows that if the hypotheses are true, then the conclusion must 
be true. Suppose, for example, that we are given hypotheses ->q — > p, q — > -ir, r; it 
is required to deduce the conclusion p. A deduction showing this, with reasons for 
each step is as follows: 





Statement 


Reason 


1. 


q — > -<r 


Hypothesis 


2. 


r 


Hypothesis 


3. 




Modus tollens (1,2) 


4. 


^q^p 


Hypothesis 


5. 


P 


Modus ponens (3,4) 



3.1.6 PREDICATE CALCULUS 

Unlike propositional calculus, which may be considered the skeleton of logical dis- 
course, predicate calculus is the language in which most mathematical reasoning 
takes place. It uses the symbols of propositional calculus, with the exception of the 
propositional variables p, q, . . . . Predicate calculus uses the universal quanti er V, 
the existential quanti er 3, predicates P{x), Q{x, y), . . . , variables x,y, . . . , and 
assumes a universe U from which the variables are taken. The quanti er s are illus- 
trated in the following table. 

Symbol Read as Usage Interpretation 

3 There exists an 3x(x > 10) There is an x such that x > 10 

V For all \/x\x 2 + 1^0) For all x, x 2 + 1 ^ 

Predicates are variable statements which may be true or false, depending on the 
values of its variable. In the above table, "x > 10" is a predicate in the one variable 
x as is "a; 2 + 1 ^ 0". Without a given universe, we have no way of deciding whether 
a statement is true or false. Thus Vx(x' 2 + 1 ^ 0) is true if the universe U is the 
real numbers, but false if U is the complex numbers. A useful rule for manipulating 
quanti ers is 

-NxP{x) i — > 3x^P(x). 

For example, it is not true that all people are mortal if, and only if, there is a person 
who is immortal. Here the universe U is the set of people, and P(x) is the predicate 
"x is mortal". This works with more than one quanti er . Thus, 

-Nx3yP(x,y) < — > 3x\/y-iP(x,y). 

For example, if it is not true that every person loves someone, then it follows that 
there is a person who loves no one (and vice versa). 

Fermat's last theorem, stated in terms of the predicate calculus (U = the positive 
integers), is 
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VnVaV6Vc[(n > 2) -» (a™ + b n ^ c")]. 

It was proven in 1995; its proof is extremely complicated. One does not expect a 
simple deduction, as in the propositional calculus. 

In 1931, Godel proved the Godel Incompleteness Theorem. This states that, in 
any logical system complex enough to contain arithmetic, it will always be possible 
to nd a true result which is not formally provable using predicate logic. This result 
was especially startling because the notion of truth and provability had been often 
identi ed with each other. 



3.2 SET THEORY 



3.2.1 SETS 

A set is a collection of objects. Some examples of sets are 

1. The population of Cleveland on January 1, 1995 

2. The real numbers between and 1 inclusive 

3. The prime numbers 2, 3, 5, 7, 11,... 

4. The numbers 1, 2, 3, and 4 

5. All of the formulae in this book 



3.2.2 SET OPERATIONS AND RELATIONS 

If x is an element in a set A, then we write x € A (read "x is in A"). If x is not in 
A, we write x $ A. When considering sets, a set U, called the universe, is chosen, 
from which all elements are taken. The null set or empty set is the set containing 
no elements. Thus, x $ for all x € U. Some relations on sets are as follows: 

Relation Read as De nition 

A C B A is contained in B Any element of A is also an element of B 
A = B A equals B (A C B) A (B C A) 

Some basic operations on sets are as follows: 



Operation 



Read as 



De nition 



AUB 
AHB 
A-B 

A 1 or A or A c 
P(A) or 2 A 

A® B 



A union B 

A intersection B 

A minus B 

Complement of A 

Power set of A 

Symmetric difference of 

,4 and 5 



The elements in A or in B 
The elements in both A and B 
The elements in A which are not in B 
The elements in U which are not in A 
The collection of all subsets of A 
The elements of A and B that are not 
in both A and B (i.e., the union 
minus the intersection) 
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3.2.3 CONNECTION BETWEEN SETS AND PROBABILITY 



Set concept 



Probability concept 



Set 

Set containing a single element 

Set containing more than one 

element 
Universal set or space 

Complement of a set 

Function on the universal set 

Measure of a set 

Integral with respect to the measure 



Event 

Indecomposable, elementary, or 

atomic event 
Compound event 

Sample space 

Non-occurrence of an event 
Random variable 
Probability of an event 
Expectation or expected value 



3.2.4 VENN DIAGRAMS 

The operations and relations on sets can be illustrated by Venn diagrams. The dia- 
grams below show a few possibilities. 




A u B 



An B 



A-B 





A AcB 

Venn diagrams can be constructed to show combinations of 
many events. Each of the 2 4 regions created by the rectangles in 
the diagram to the right represents a different combination. 



3.2.5 PARADOXES AND THEOREMS OF SET THEORY 
3.2.5.1 Russell's paradox 

In about 1900, Bertrand Russell presented a paradox, paraphrased as follows: since 
the elements of sets can be arbitrary, sets can contain sets as elements. Therefore, a 
set can possibly be a member of itself. (For example, the set of all sets would be a 
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member of itself. Another example is the collection of all sets that can be described 
in fewer than 50 words.) Now let A be the set of all sets which are not members of 
themselves. Then if A is a member of itself, it is not a member of itself. And if A 
is not a member of itself, then, by de nitio n, A is a member of itself. This paradox 
leads to a much more careful evaluation of how sets should be de ned . 



3.2.5.2 In nite sets and the continuum hypothesis 

Georg Cantor showed how the number of elements of in nite sets can be counted, 
much as nite sets. He used the symbol K (read "aleph null") for the number of 
integers and introduced larger in nite numbers such as K i , K 2 , and so on. Cantor in- 
troduced a consistent arithmetic on in nite cardinals and a way of comparing in nite 
cardinals. A few of his results were as follows: 

Cantor showed that c = 2^° > No, where c is the cardinality of real numbers. 
The continuum hypothesis asks whether or not c = K i , the rst in nite cardinal 
greater than No- In 1963, Paul J. Cohen showed that this result is independent of the 
other axioms of set theory. In his words, ". . . the truth or falsity of the continuum 
hypothesis . . . cannot be determined by set theory as we know it today". 



3.2.6 INCLUSION/EXCLUSION 

Let {a\ , a<i , . . . , a r } be properties that the elements of a set may or may not have. If 
the set has N objects, then the number of objects having exactly to properties (with 
m < r), e m , is given by 

(m + 1\ (m + 2\ (m + 3\ 

e m =Sm-| 1 Js m+ i+l 2 ls m+2 -l Js m+3 + ... (3.2.1) 

••■+<->KT)'~-- +( - ir "(^-;rO*- 

Here s t = ^ ^( a h a « 2 ' ' ' a u ) i s me number of elements that have , . . . . When 
to = 0, this is the usual inclusion/exclusion rule: 

e = s - si +s 2 h (-l) r s r , 

(3 2 2) 

= N -J2 N ( a i) + N ( a i a i) ~ N (aiaja k ) + ■■■ 

i i,j distinct k distinct 

3.2.7 PARTIALLY ORDERED SETS 

Consider a set S and a relation on it. Given any two elements x and y in S, we can 
determine whether or not x is "related" to y; if it is, "x ^ y". The relation will 
be a partial order on S if it satis es the following three conditions: 

re e xive s ^ s for every s € S, 
antisymmetric s ^ t and t < s imply s = t, and 
transitive s <t and t < u imply s <u. 
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FIGURE 3.1 

Left: Hasse diagram for integers up to 12 with x < y meaning "the number x divides the 
number y". Right: Hasse diagram for the power set of {a, b, c} with x <y meaning "the set 
x is a subset of the set y". 




If < is a partial order on S, then the pair (S, is called a partially ordered set 
or a poset. Given the partial order -< on the set S, de ne the relation -< by 

x -< y if and only if x <y and x ^ y. 

We say that the element t covers the element s if s -< t and there is no element u 
with s -< u -< t. A Hasse diagram of the poset (S, ■<) is a gure consisting of the 
elements of S with a line segment directed generally upward from s to t whenever t 
covers s. (See Figure 3.1.) 

Two elements x and y in a poset (S, ■<) are said to be comparable if either x <y 
or y < x. If every pair of elements in a poset is comparable, then (S, is a chain. 
An antichain is a poset in which no two elements are comparable (i.e., x < y if and 
only if x = y for all x and y in the antichain). A maximal chain is a chain that is not 
properly contained in another chain (and similarly for a maximal antichain). 

EXAMPLES 

1. Let S be the set of natural numbers up to 12 and let "a: ^ y" mean "the number 
x divides the number y". Then (S, ^) is a poset with the Hasse diagram shown in 
Figure 3. 1 (left). Observe that the elements 2 and 4 are comparable, but elements 2 and 
5 are not comparable. 

2. Let S be the set of all subsets of the set {a, b, c] and let "a: ■< y" mean "the set x 
is contained in the set y". Then (S, ■<) is a poset with the Hasse diagram shown in 
Figure 3.1 (right). 

3. There are 16 different isomorphism types of posets of size 4. There are 5 different 
isomorphism types of posets of size 3, shown below: 

a b c a a a b a 

"' b A V i- 

b b c c c 
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3.3 COMBINATORICS 



3.3.1 SAMPLE SELECTION 

There are four diffeent ways in which a sample of r elements can be obtained from 
a set of n distinguishable objects. 



Order 


Repetitions 


The sample is called an 


Number of ways to 


counts? 


allowed? 




choose the sample 


No 


No 


r-combination 


C(n,r) 


Yes 


No 


r-permutation 


P(n, r) 


No 


Yes 


r-combination with replacement 


C R (n,r) 


Yes 


Yes 


r-permutation with replacement 


P R (n,r) 



where 



C(n,r) 



y r J r! (n — r)! ' 
P(n, r) = (n) r = n 



C R (n,r) = C(n + r - l,r) = ( " + - -ff , and 

r!(n — li' 

P R {n,r) =n r . 



(n-r)V (3.3.1) 
n + r-1] 
r!(n - 1)! 



EXAMPLE There are four ways to choose a 2-element sample from the set {a, b}: 

r-combination C(2,2) = l ab 

r-permutation P(2, 2) = 2 ab and ba 

r-combination with replacement C R (2, 2) = 3 aa, ab, and bb 

r-permutation with replacement P B (2,2)=4 aa, ab, ba, and bb 



3.3.2 BALLS INTO CELLS 

There are eight different ways in which n balls can be placed into k cells: 



Distinguish Distinguish Can cells Number of ways to 
the balls? the cells? be empty? place n balls into k cells 



Yes Yes Yes k n 

Yes Yes No k\ {"} 

Yes No Yes { \ } + {"} + ••• + {£} 

Yes No No {£} 

No Yes Yes C(k+n- 1, n) = 

No Yes No C(n - 1, k - 1) = ("ij) 

No No Yes pi (n) + p 2 (n) + . . . + _pft (n) 

No No No Pfc(n) 
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where {^} is the Stirling subset number (see page 213) andp^(n) is the number of 
partitions of the number n into exactly k integer pieces (see page 210). 

Given n distinguishable balls and k distinguishable cells, the number of ways in 
which we can place n\ balls into cell 1, n-i balls into cell 2, . . ., nu balls into cell k, 
is given by the multinomial coef cien t ( n ™ ) ( see P a g e 209). 

EXAMPLE Consider placing n = 3 balls into k = 2 cells. Let {A, B, C} denote the 
names of the balls (when needed) and {a, b, c] denote the names of the cells (when 
needed). A cell will be denoted Uke this . Begin with: Are the balls distinguishable? 

1. Yes, the balls are distinguishable. Are the cells distinguishable? 

(a) Yes, the cells are distinguishable. Can the cells be empty? 



i. Yes. Number of 


ways is k n 


= 2 3 = 8: 




ABC 




ABC 
















a 


b 




a b 




A BC 




B AC 




C AB 




BC A 




AC B 




AB C 




a b 




a b 




a b 




a 


b 




a 






a b 


ii. No. Number of ways is k\ {"} = 2! \ 3 2 } 


= 6: 














A BC 




B AC 




C AB 




BC A 




AC B 




AB C 




a b 




a b 




a b 




a 


b 




a 


f> 




a b 



(b) No, the cells are not distinguishable. Can the cells be empty? 

i. Yes. Number of ways is {?} + . . . + {£} = {^} + {^} = 1 + 3 = 4: 



ABC 



A BC 



B AC 



C AB 



ii. No. Number of ways is {^} = {1} = 3: 



A BC 



B AC 

l—l I I 



C AB 



2. No, the balls are not distinguishable. Are the cells distinguishable? 
(a) Yes, the cells are distinguishable. Can the cells be empty? 
i. Yes. Number of ways is = Q = 4: 



ii. No. Number of ways is = (f) = 2: 



• 

■ 1 1 i 

a b 



• •• 

l—l 

a b 



• • • 

I 1 1 I 

a b 



• • • 

l—l 

a b 



(b) No, the cells are not distinguishable. Can the cells be empty? 

i. Yes. Number of ways is pi (n) + . . .+pk(n) = pi(3)+p2(3) = 1 + 1 = 2: 



ii. No. Number of ways is p k (n) = pi (3) = 1 : 
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3.3.3 BINOMIAL COEFFICIENTS 

The binomial coef cien t C(n,m) = (^) is the number of ways of choosing to 
objects from a collection of n distinct objects without regard to order: 

EXAMPLE For the 5 element set {a, b, c, d, e} there are (3) = ^ = 10 subsets con- 
taining exactly three elements. They are: 

{a,b,c}, {a,b,d}, {a,b, e}, {a,c,d}, {a,c,e}, 
{a,d, e}, {b, c, d}, {b, c, e}, {b, d, e}, {c, d, e}. 

Properties of binomial coef cients include: 

I n! n(n — 1) • • • (n — m + 1) ^ n 



to/ m!(n — to)! to! \n — to 



3. 



2n^ _ 2 n (2n-l)!! _ 2 n (2n - l)(2n - 3) • • • 3 • 1 
n 



4. If n and to are integers, and to > n, then (^) = 0. 

5. The recurrence relation: = (") + ( »). 

V m / Vm/ Vm— 1/ 

6. Two generating functions for binomial coef cients are X!m=o (™)£ r 
(1 + a;)- for n = 1,2,..., and £~ m ( m )*"~ m = (1 - x)- m ~\ 

7. The Vandermonde convolution is ( j = (J ( J . 



3.3.3.1 Pascal's triangle 

The binomial coef cien ts (™) can be arranged in a triangle in which each number is 
the sum of the two numbers above it. For example (2) = (J) + (I) . 



1 

1 1 
1 2 1 
13 3 1 
1 4 6 4 1 
1 5 10 10 5 1 
1 6 15 20 15 6 1 
1 7 21 35 35 21 7 1 
1 8 28 56 70 56 28 8 1 





0) (?) (;) (3 

:) (:) (f) ft) c: 
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3.3.3.2 Binomial coef cient relationships 

The binomial coef cien ts satisfy 



(n + 1\ _ /n\ + f n \ 
\m + 1/ \m J \m + 1/ ' 




3.3.4 MULTINOMIAL COEFFICIENTS 

The multinomial coef cien t („ " „ ) (also written C(n; m , ri2 , . . . , is the 
number of ways of choosing m objects, then n 2 objects, . . . , then n k objects from a 
collection of n distinct objects without regard to order. This requires that Yl'j-i n j = 
n. The multinomial symbol is numerically evaluated as 



n 



ni,n 2 , ■ ■ - ,n k J ni\n 2 \ ■■■ n k \ ' 



(3.3.2) 



EXAMPLE The number of ways to choose 2 objects, then 1 object, then 1 object from 
the set {a, b, c, d} is ( 2 * J = 12; they are as follows (vertical bars show the ordered 
selections): 

| ab | c | d |, | ab | d | c |, | ac | 6 | d |, | ac | d | 6 |, 
| ad | 6 | c j, | ad | c | 6 |, j 6c | a j d j, j be \ d \ a j, 
| 6d | a | c |, | 6d | c | a j, \ cd \ a \ b \, j cd | 6 j a j. 
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3.3.5 ARRANGEMENTS AND DERANGEMENTS 



The number of ways to arrange n distinct objects in a row is n\\ this is the number of 
permutations of n objects. For example, for the three objects {a, b, c}, the number 
of arrangements is 3! =6. These permutations are: abc, bac, cab, acb, bca, and cba. 

The number of ways to arrange n objects (assuming that there are k types 
of objects and n, copies of each object of type i) is the multinomial coef cien t 
(m n" n k ) • ^ or exam pl e > f° r the set {a, a, b, c} the parameters are n = 4, k = 3, 
rii = 2, ri2 = 1, and ri3 = 1. Hence, there are ( 2 f J = 2 n\ i! = ^ arrangements; 
they are 

aabc, aacb, abac, abca, acab, acba, 
baac, baca, bcaa, caab, caba, cbaa. 

A derangement is a permutation of objects, in which object i is not in the i th 
location. For example, all of the derangements of {1, 2, 3, 4} are 

2143, 2341, 2413, 
3142, 3412, 3421, 
4123, 4312, 4321. 

The number of derangements of n elements, D „, satis es the recursion relation, 
D n = (n — 1) (-D„-i + D n _2), with the initial values D\ = and D 2 = 1. Hence, 

^ = " ! ( 1 -T! + |-| + -- + (- 1 ^)- 

The numbers D n are also called sub-factorials or rencontres numbers. For large 
values of n, D n /nl ~ e _1 £s 0.37. Hence more than one of every three permutations 
is a derangement. 



n 


1 


2 


3 


4 


5 


6 


7 8 


9 10 


D n 





1 


2 


9 


44 


265 


1854 14833 


133496 1334961 



3.3.6 PARTITIONS 

A partition of a number n is a representation of n as the sum of any number of 
positive integral parts. The number of partitions of n is denoted p(n) . For example: 
5=4+1=3+2=3+1+1=2+2+1=2+1+1+1=1+1+1+1+1 
sothatp(5) = 7. 

1. The number of partitions of n into exactly m parts is equal to the number 
of partitions of n into parts the largest of which is exactly to; this is denoted 
p m (n). For example, p 2 (5) = 2 andp 3 (5) = 2. Note that J2 m Pm(n) = p(n). 

2. The number of partitions of n into at most to parts is equal to the number of 
partitions of n into parts which do not exceed to. 
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The generating functions for p(n) is 

OO ^ 

1 + Yl P(n)x n = j- r-j jr-j 

^ (l-a;)(l-a; 2 )(l-a; 3 )--- 



n 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


p{n) 


1 


2 


3 


5 


7 


11 


15 


22 


30 


42 


n 


11 


12 


13 


14 


15 


16 


17 


18 


19 


20 


p{n) 


56 


77 


101 


135 


176 


231 


297 


385 


490 


627 


n 


21 


22 


23 


24 


25 


26 


27 


28 


29 


30 


p{n) 


792 


1002 


1255 


1575 


1958 


2436 


3010 


3718 


4565 


5604 


n 


31 


32 


33 


34 


35 


40 


45 


50 






p{n) 


6842 


8349 


10143 


12310 


14883 


37338 


89134 


204226 







A table of p m (n) values. 
The columns sum to p(n). 



m 


n = 1 2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


1 


1 1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


2 


1 


1 


2 


2 


3 


3 


4 


4 


5 


5 


3 




1 


1 


2 


3 


4 


5 


7 


8 


10 


4 






1 


1 


2 


3 


5 


6 


9 


11 


5 








1 


1 


2 


3 


5 


7 


10 


6 










1 


1 


2 


3 


5 


7 


7 












1 


1 


2 


3 


5 


8 














1 


1 


2 


3 


9 
















1 


1 


2 


10 


















1 


1 



3.3.7 BELL NUMBERS 

The n th Bell number, B n , denotes the number of partitions of a set with n elements. 
Computationally, the Bell numbers may be written in terms of the Stirling subset 
numbers (page 213), B n = £^ =1 {£}. 



n 


1 2 


3 


4 


5 6 


7 8 9 


10 


B n 


1 2 


5 


15 


52 203 


877 4140 21147 


115975 



1. A generating function for Bell numbers is Xl^Lo Bn% n = exp (e x — 1) — 1. 
This gives Dobinski's formula: B n = e _1 2~^m=o m "/ TO " 

2. For large values of n, B n ~ n~ 1 / 2 [A(n)]" +1 / 2 e A (™)~™~ 1 where A(n) is de- 
ned by the relation: A(n) log A(n) = n. 

EXAMPLE There are Bn = 15 different ways to partition the 4 element set {a, b, c, d}: 

{a},{c},{b,d}, {a},{d},{b,c}, {b}, {c}, {a, d}, {b}, {d}, {a, c], 

{c},{d},{a,b}, {a,b,c,d}, {a,b},{c,d}, {a,c},{b,d}, 

{a,d},{b,c}, {a},{b},{c},{d}, {a},{b,c,d}, {b},{a,c,d}, 

{c}, {a,b,d}, {d},{a,b,c), {a}, {b}, {c, d}. 
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3.3.8 CATALAN NUMBERS 



The Catalan numbers are C n 



1 (In - 2 



n — 1 V n — 2 



. There is the recurrence relation: 



(3.3.4) 





C n — 


CoC n - 


1 + C\C n -2 


+ . . . + C„_ 


iCo- 




n 


1 


2 3 


4 5 6 


7 8 


9 


10 


C n 


72 i 


1 2 


5 14 42 


132 429 


1430 


4862 



EXAMPLE Given the product A\A 2 . . . A n , the number of ways to pair terms keeping 
the original order is C n . For example, with n = 4, there are C4 = 5 ways to group the 
terms; they are (A 1 A 2 )(A 3 A 4 ), ((A 1 A 2 )A 3 )A 4 , (A 1 (A 2 A 3 ))A 4 , A 1 ((A 2 A 3 )A 4 ), 
and A 1 {A 2 {A 3 A i )). 



3.3.9 STIRLING CYCLE NUMBERS 

The number [^] , called a Stirling cycle number, is the number of permutations of n 
symbols which have exactly k non-empty cycles. 



EXAMPLE For the 4 element set {a, b, c, d}, there are [*] 
exactly 2 cycles. They are 



1234 
2314 



/1234\ 
^42137 



1234 
1342 

'12 34 
,3412 



(123)(4), 
(143)(2), 
(234)(1), 
(13)(24), 



1234 
3124 

12 34 
2431 

12 34 
1423 

1234 
4321 



(132)(4), 
(124)(3), 
(243)(1), 
(14)(23). 



11 permutations containing 



1234 
3241 

12 34 
4132 

12 34 
2143 



(134)(2), 
(142)(3), 
(12)(34), 



3.3.9.1 Properties of Stirling cycle numbers [^] 



(n-l) 



n — 1 




n — 


1" 


* 


+ n 






1 



for k > 0. 



1 ifn = 
ifn^O 



3-E 

k=0 



4. 



where 



n — k y 

E(-!) m (. 

f n — to — fc] . 
1 * I 1 



n — 1 + m\ / 2n — k \ j n — m — k s 
n — k + m ) \n — m — k I \ m 



is a Stirling subset number. 
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x n (logfl + x)) 

5. 2__, s ( n > ~~ j" = f° r l x l < 1- Here s(n, fc) is a Stirling number 

of the r st kind and can be written as s(n, k) = (—l) n ~ k [^] . 

6. The factorial polynomial, de ned as x^ = x(x — 1) • • • (x — n + 1) with 
a;( ) = l ; C an be written as 

n 

x (n) = s (n, k)x k = s(n, l)x + s(n, 2)x 2 + . . . + s(n, n)x n (3.3.5) 
For example: x (3) = x(x-l)(x-2) = 2x-3x 2 + x 3 = [I] x - x 2 + [3] x 3 . 



3.3.9.2 Table of Stirling cycle numbers [£] 





k 


n 





1 


2 


3 


4 


5 


6 


7 





1 
















1 





1 














2 





1 


1 












3 





2 


3 


1 










4 





6 


11 


6 


1 








5 





24 


50 


35 


10 


1 






6 





120 


274 


225 


85 


15 


1 




7 





720 


1764 


1624 


735 


175 


21 


1 


8 





5040 


13068 


13132 


6769 


1960 


322 


28 


9 





40320 


109584 


118124 


67284 


22449 


4536 


546 


10 





362880 


1026576 


1172700 


723680 


269325 


63273 


9450 



3.3.10 STIRLING SUBSET NUMBERS 

The Stirling subset number, {^}, is the number of ways to partition n into k blocks. 
Equivalently, it is the number of ways that n distinguishable balls can be placed into 
k indistinguishable cells, with no cell empty. 

EXAMPLE Placing the 4 distinguishable balls {a, b, c, d} into 2 indistinguishable cells, 
so that no cell is empty, can be done in { *} = 7 ways. These are (vertical bars delineate 
the cells) 

| ab | cd |, | ad | be |, | ac \ bd |, | a \ bed |, 
| b | acd |, | c | abd |, | d \ abc \ . 



3.3.10.1 Properties of Stirling subset numbers {£} 

1 . Stirling subset numbers are also called Stirling numbers of the second kind, 
and are denoted by S(n, k). 
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{n\ = [l ifn = 4 . W =r i_ L 

' \0J |0 ifn^O. l 2 J 

-{:}■{:}■'■ 5 I.{^^- 
7 {i}^s<-^'C)-" 

8. Ordinary powers can be expanded in terms of factorial polynomials. If n > 0, 
then 

*- = t { n k y ] = {o}- (o) + { + • • • + {iy ] - ^ 

For example, 

* 3 ={iy i+ {iy> + {iy i+ {$° m 
= {o} + {?} i+ {'}*- i)+ {3}*- iki - 2) °' 3 ' 7) 

= + x + 3(x 2 -x) + (x 3 - 3x 2 + 2x). 



3.3.10.2 Table of Stirling subset numbers {^} 





k 


n 





1 


2 


3 


4 


5 


6 


7 





1 
















1 





1 














2 





1 


1 












3 





1 


3 


1 










4 





1 


7 


6 


1 








5 





1 


15 


25 


10 


1 






6 





1 


31 


90 


65 


15 


1 




7 





1 


63 


301 


350 


140 


21 


1 


8 





1 


127 


966 


1701 


1050 


266 


28 


9 





1 


255 


3025 


7770 


6951 


2646 


462 


10 





1 


511 


9330 


34105 


42525 


22827 


5880 


11 





1 


1023 


28501 


145750 


246730 


179487 


63987 


12 





1 


2047 


86526 


611501 


1379400 


1323652 


627396 


13 





1 


4095 


261625 


2532530 


7508501 


9321312 


5715424 


14 





1 


8191 


788970 


10391745 


40075035 


63436373 


49329280 


15 





1 


16383 


2375101 


42355950 


210766920 


420693273 


408741333 
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3.3.11 TABLES 

3.3.1 1 .1 Permutations P(n, m) 

These tables contain the number of permutations of n distinct things taken to at a 



time, given by P(n, m) = : — — = n(n — 1) • • • (n — to + 1). 

(n — my. 





m 


n 


u 


i 
i 


L 


Q 
J 




J 





7 


o 
o 


u 


i 
i 


















i 
i 


i 
i 


i 
i 
















L 


1 


2 


2 














3 


1 


3 


6 


6 












4 


1 


4 


12 


24 


24 










5 


1 


5 


20 


60 


120 


120 








6 


1 


6 


30 


120 


360 


720 


720 






7 


1 


7 


42 


210 


840 


2520 


5040 


5040 




8 


1 


8 


56 


336 


1680 


6720 


20160 


40320 


40320 


9 


1 


9 


72 


504 


3024 


15120 


60480 


181440 


362880 


10 


1 


10 


90 


720 


5040 


30240 


151200 


604800 


1814400 


11 


1 


11 


110 


990 


7920 


55440 


332640 


1663200 


6652800 


12 


1 


12 


132 


1320 


11880 


95040 


665280 


3991680 


19958400 


13 


1 


13 


156 


1716 


17160 


154440 


1235520 


8648640 


51891840 


14 


1 


14 


182 


2184 


24024 


240240 


2162160 


17297280 


121080960 


15 


1 


15 


210 


2730 


32760 


360360 


3603600 


32432400 


259459200 





m 


n 


9 


10 


11 


12 


13 


9 


362880 










10 


3628800 


3628800 








11 


19958400 


39916800 


39916800 






12 


79833600 


239500800 


479001600 


479001600 




13 


259459200 


1037836800 


3113510400 


6227020800 


6227020800 


14 


726485760 


3632428800 


14529715200 


43589145600 


87178291200 


15 


1816214400 


10897286400 


54486432000 


217945728000 


653837184000 



3.3.11.2 Combinations C(n, m) = (£) 

These tables contains the number of combinations of n distinct things taken m at a 

f Tl\ Tl\ 

time, given by C(n, to) = = — — : --. 

\to J m\(n — my. 





m 


n 





1 


2 


3 


4 


5 


6 


7 


1 


1 


1 














2 


1 


2 


1 












3 


1 


3 


3 


1 










4 


1 


4 


6 


4 


1 








5 


1 


5 


10 


10 


5 


1 
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m 


n 


n 
U 


1 
1 


Z 


Q 
J 


A 
4 


j 





7 







6 


15 


20 


15 


6 


1 




7 


j 


7 


21 


35 


35 


21 


7 


1 


8 


j 


8 


28 


56 


70 


56 


28 


8 


9 


j 


9 


36 


84 


126 


126 


84 


36 


10 


1 


10 


45 


120 


210 


252 


210 


120 


1 1 
1 1 


j 


11 


55 


165 


330 


462 


462 


330 


12 


j 


12 


66 


220 


495 


792 


924 


792 


13 


j 


13 


78 


286 


715 


1287 


1716 


1716 


14 


j 


14 


91 


364 


1001 


2002 


3003 


3432 


15 


1 


15 


105 


455 


1365 


3003 


5005 


6435 


10 




16 


120 


560 


1820 


4368 


8008 


11440 


17 


j 


17 


136 


680 


2380 


6188 


12376 


19448 


18 


j 


18 


153 


816 


3060 


8568 


18564 


31824 


19 


j 


19 


171 


969 


3876 


11628 


27132 


50388 


20 


1 


20 


190 


1140 


4845 


15504 


38760 


77520 


o 1 


j 


21 


210 


1330 


5985 


20349 


54264 


116280 


22 


j 


22 


231 


1540 


7315 


26334 


74613 


170544 


23 


j 


23 


253 


1771 


8855 


33649 


100947 


245157 


24 


j 


24 


276 


2024 


10626 


42504 


134596 


346104 


25 


j 


25 


300 


2300 


12650 


53130 


177100 


480700 


26 


1 


26 


325 


2600 


14950 


65780 


230230 


657800 


27 


1 


27 


351 


2925 


17550 


80730 


296010 


888030 


28 


1 


28 


378 


3276 


20475 


98280 


376740 


1184040 


29 


1 


29 


406 


3654 


23751 


118755 


475020 


1560780 


30 






A 1 £ 


4U0U 


Z /41D 


i a 

14zjUo 


jyi 1 1 j 


ZUjjsUU 


^ 1 


j 


31 


465 


4495 


31465 


169911 


736281 


2629575 


32 


j 


32 


496 


4960 


35960 


201376 


906192 


3365856 


33 


j 


33 


528 


5456 


40920 


237336 


1107568 


4272048 


34 


j 


34 


561 


5984 


46376 


278256 


1344904 


5379616 


35 


1 


35 


595 


6545 


52360 


324632 


1623160 


6724520 


36 




36 


630 


7140 


58905 


376992 


1947792 


8347680 


37 




37 


666 


7770 


66045 


435897 


2324784 


10295472 


38 




38 


703 


8436 


73815 


501942 


2760681 


12620256 


39 




39 


741 


9139 


82251 


575757 


3262623 


15380937 


40 




40 


780 


9880 


91390 


658008 


3838380 


18643560 





m 


n 


8 


9 


10 


11 


12 


8 


1 










9 


9 


1 








10 


45 


10 


1 






11 


165 


55 


11 


1 




12 


495 


220 


66 


12 


1 


13 


1287 


715 


286 


78 


13 


14 


3003 


2002 


1001 


364 


91 
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m 


n 


8 


9 


10 


11 


12 


15 


6435 


5005 


3003 


1365 


455 


16 


12870 


11440 


8008 


4368 


1820 


17 


24310 


24310 


19448 


12376 


6188 


1(5 


43758 


48620 


43758 


31824 


18564 


19 


75582 


92378 


92378 


75582 


50388 


20 


125970 


167960 


184756 


167960 


125970 


21 


203490 


293930 


352716 


352716 


293930 


22 


319770 


497420 


646646 


705432 


646646 


Id 


490314 


817190 


1144066 


1352078 


1352078 


24 


735471 


1307504 


1961256 


2496144 


2704156 


25 


1081575 


2042975 


3268760 


4457400 


5200300 


26 


1562275 


3124550 


5311735 


7726160 


9657700 


27 


2220075 


4686825 


8436285 


13037895 


17383860 


Zo 


3108105 


6906900 


13123110 


21474180 


30421755 


29 


4292145 


10015005 


20030010 


34597290 


51895935 


30 


5852925 


14307150 


30045015 


54627300 


86493225 


31 


7888725 


20160075 


44352165 


84672315 


141120525 


32 


10518300 


28048800 


64512240 


129024480 


225792840 


n 


13884156 


38567100 


92561040 


193536720 


354817320 


34 


18156204 


52451256 


131128140 


286097760 


548354040 


35 


23535820 


70607460 


183579396 


417225900 


834451800 


36 


30260340 


94143280 


254186856 


600805296 


1251677700 


37 


38608020 


124403620 


348330136 


854992152 


1852482996 


38 


48903492 


163011640 


472733756 


1203322288 


2707475148 


39 


61523748 


211915132 


635745396 


1676056044 


3910797436 


40 


76904685 


273438880 


847660528 


2311801440 


5586853480 





m 


n 


13 


14 


15 


16 


17 


13 


1 










14 


14 


1 








15 


105 


15 


1 






16 


560 


120 


16 


1 




17 


2380 


680 


136 


17 


1 


18 


8568 


3060 


816 


153 


18 


19 


27132 


11628 


3876 


969 


171 


20 


77520 


38760 


15504 


4845 


1140 


21 


203490 


116280 


54264 


20349 


5985 


22 


497420 


319770 


170544 


74613 


26334 


23 


1 144066 


817190 


490314 


245157 


100947 


24 


2496144 


1961256 


1307504 


735471 


346104 


25 


5200300 


4457400 


3268760 


2042975 


1081575 


26 


10400600 


9657700 


7726160 


5311735 


3124550 


27 


20058300 


20058300 


17383860 


13037895 


8436285 
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m 


n 




1 A 


i c 

i j 


1 & 


1 7 
1 / 


Zo 


37442160 


40116600 


37442160 


30421755 


21474180 


29 


67863915 


77558760 


77558760 


67863915 


51895935 


30 


119759850 


145422675 


155117520 


145422675 


119759850 


31 


206253075 


265182525 


300540195 


300540195 


265182525 


32 


347373600 


471435600 


565722720 


601080390 


565722720 


jj 


573166440 


818809200 


1037158320 


1166803110 


1166803110 


34 


927983760 


1391975640 


1855967520 


2203961430 


2333606220 


35 


1476337800 


2319959400 


3247943160 


4059928950 


4537567650 


36 


2310789600 


3796297200 


5567902560 


7307872110 


8597496600 


37 


3562467300 


6107086800 


9364199760 


12875774670 


15905368710 


38 


5414950296 


9669554100 


15471286560 


22239974430 


28781143380 


39 


8122425444 


15084504396 


25140840660 


37711260990 


51021117810 


40 


12033222880 


23206929840 


40225345056 


62852101650 


88732378800 



3.3.11.3 Fractional binomial coef cients (£) 





k 


a 


1 


2 


3 


4 


5 


1/2 


1 1/2 


-1/8 


1/16 


—5/128 


7/256 


1/3 


1 I/O 


1 /Q 

-i/y 


Of ol 




OO /70Q 

zz / / zy 


1/4 


1 1/4 

/ 


-3/32 


7/128 


-77/2048 


231/8192 


1/5 


1 1/5 


-2/25 


6/125 


-21/625 


399/15625 


1/6 


1 1/6 


-5/72 


55/1296 


-935/31104 


4301/186624 


1/7 


1 1/7 


-3/49 


13/343 


-65/2401 


351/16807 


1/8 


1 1/8 


-7/128 


35/1024 


-805/32768 


4991/262144 


1/9 


1 1/9 


-4/81 


68/2187 


-442/19683 


3094/177147 


2/3 


1 2/3 


-1/9 


4/81 


-7/243 


14/729 


2/5 


1 2/5 


-3/25 


8/125 


-26/625 


468/15625 


2/7 


1 2/7 


-5/49 


20/343 


-95/2401 


494/16807 


2/9 


1 2/9 


-7/81 


112/2187 


-700/19683 


4760/177147 


3/4 


1 3/4 


-3/32 


5/128 


-45/2048 


117/8192 


3/5 


1 3/5 


-3/25 


7/125 


-21/625 


357/15625 


3/7 


1 3/7 


-6/49 


22/343 


-99/2401 


495/16807 


3/8 


1 3/8 


-15/128 


65/1024 


-1365/32768 


7917/262144 


4/5 


1 4/5 


-2/25 


4/125 


-11/625 


176/15625 


4/7 


1 4/7 


-6/49 


20/343 


-85/2401 


408/16807 


4/9 


1 4/9 


-10/81 


140/2187 


-805/19683 


5152/177147 


5/6 


1 5/6 


-5/72 


35/1296 


-455/31104 


1729/186624 


5/7 


1 5/7 


-5/49 


15/343 


-60/2401 


276/16807 


5/8 


1 5/8 


-15/128 


55/1024 


-1045/32768 


5643/262144 


5/9 


1 5/9 


-10/81 


130/2187 


-715/19683 


4433/177147 


6/7 


1 6/7 


-3/49 


8/343 


-30/2401 


132/16807 


7/8 


1 7/8 


-7/128 


21/1024 


-357/32768 


1785/262144 


7/9 


1 7/9 


-7/81 


77/2187 


-385/19683 


2233/177147 


8/9 


1 8/9 


-4/81 


40/2187 


-190/19683 


1064/177147 
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3.4 GRAPHS 



3.4.1 NOTATION 

3.4.1.1 Notation for graphs 

E edge set V vertex set 

G graph <f> incidence mapping 



3.4.1.2 Graph invariants 



Aut(G) 


automorphism group 


c(G) 


circumference 


d(u, v) 


distance between two vertices 


diam(G) 


diameter 


dega; 


degree of a vertex 


e(G) 


size 


ecc(x) 


eccentricity 


gir(G) 


girth 


rad(G) 


radius 


Pg(x) 


chromatic polynomial 


Z(G) 


center 


a(G) 


independence number 


X(G) 


chromatic number 


X'(G) 


chromatic index 


8(G) 


minimum degree 


A(G) 


maximum degree 


7 (G) 


genus 


7 (G) 


crosscap number 


k(G) 


vertex connectivity 


A(G) 


edge connectivity 


V ( G ) 


crossing number 


17(G) 


rectilinear crossing number 


0(G) 


thickness 


T(G) 


arboricity 


co(G) 


clique number 


|G| 


order 



3.4.1 .3 Examples of graphs 



C n 


cycle 


O n 


odd graph 


K n 


empty graph 


Pn 


path 


K n 


complete graph 


Qn 


cube 




complete bipartite graph 


$n 


star 




Kneser graphs 




Turan graph 


M n 


Mobius ladder 


w n 


wheel 



3.4.2 BASIC DEFINITIONS 

There are two standard de nitions of graphs, a general de nition and a more com- 
mon simpli cation. Except where otherwise indicated, this book uses the simpli ed 
de nition , according to which a graph is an ordered pair (V, E) consisting of an ar- 
bitrary set V and a set E of 2-element subsets of V . Each element of V is called a 
vertex (plural vertices). Each element of E is called an edge. 



© 2003 by CRC Press LLC 



According to the general de nition , a graph is an ordered triple G = (V, E, <f>) 
consisting of arbitrary sets V and E and an incidence mapping <j> that assigns to each 
element e G E a non-empty set <f>{e) C V of cardinality at most two. Again, the 
elements of V are called vertices and the elements of E are called edges. A loop is 
an edge e for which | <^(e) | = 1 . A graph has multiple edges if edges e ^ e ' exist for 
which (j>(e) = <j>{e'). 

A (general) graph is called simple if it has neither loops nor multiple edges. Be- 
cause each edge in a simple graph can be identi ed with the two-element set (f>(e) C 
V, the simpli ed de nition of graph given above is just an alternative de nition of a 
simple graph. 

The word multigraph is used to discuss general graphs with multiple edges but 
no loops. Occasionally the word pseudograph is used to emphasize that the graphs 
under discussion may have both loops and multiple edges. Every graph G = (V, E) 
considered here is nite , i.e., both V and E are nite sets. 

Specialized graph terms include the following: 

acyclic: A graph is acyclic if it has no cycles. 

adjacency: Two distinct vertices v and w in a graph are adjacent if the pair {v, w} 
is an edge. Two distinct edges are adjacent if their intersection is non-empty, 
i.e., if there is a vertex incident with both of them. 

adjacency matrix: For an ordering v i , v-i , . . . , v n of the vertices of a graph G = 
(V, E) of order \G\ = n, there is a corresponding nxn adjacency matrix A = 
(ciij) de ned as follows: 



arboricity: The arboricity T(G) of a graph G is the minimum number of edge- 
disjoint spanning forests into which G can be partitioned. 

automorphism: An automorphism of a graph is a permutation of its vertices that 
is an isomorphism. 

automorphism group: The composition of two automorphisms is again an auto- 
morphism; with this binary operation, the automorphisms of a graph G form a 
group Aut(G) called the automorphism group of G. 

ball: The ball of radius k about a vertex u in a graph is the set 



See also sphere and neighborhood. 

block: A block is a graph with no cut vertex. A block of a graph is a maximal 
subgraph that is a block. 




(3.4.1) 



B(u,k) = {v G V | d(u,v) < k}. 



(3.4.2) 
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boundary operator: The boundary operator for a graph is the linear mapping 
from 1-chains (elements of the edge space) to 0-chains (elements of the vertex 
space) that sends each edge to the indicator mapping the set of two vertices 
incident with it. See also vertex space and edge space. 

bridge: A bridge is an edge in a connected graph whose removal would disconnect 
the graph. 

cactus: A cactus is a connected graph, each of whose blocks is a cycle. 

cage: An (r,n)-cage is a graph of minimal order among r-regular graphs with 
girth n. A (3, n)-cage is also called an n-cage. 

center: The center Z(G) of a graph G = (V, E) consists of all vertices whose 
eccentricity equals the radius of G: 

Z(G) = {vG V(G) | ecc(v) = rad(G)}. (3.4.3) 

Each vertex in the center of G is called a central vertex. 

characteristic polynomial: All adjacency matrices of a graph G have the same 
characteristic polynomial, which is called the characteristic polynomial of G. 

chromatic index: The chromatic index x'(G) is the least k for which there exists 
a proper ^-coloring of the edges of G; in other words, it is the least number of 
matchings into which the edge set can be decomposed. 

chromatic number: The chromatic number x(G) of a graph G is the least k for 
which there exists a proper ^-coloring of the vertices of G; in other words, it 
is the least k for which G is A; -partite. See also multipartite. 

chromatic polynomial: For a graph G of order |G| = n with exactly k connected 
components, the chromatic polynomial of G is the unique polynomial Pq {x) 
for which Pq (to) is the number of proper colorings of G with to colors for 
each positive integer to. 

circuit: A circuit in a graph is a trail whose rst and last vertices are identical. 

circulant graph: A graph G is a circulant graph if its adjacency matrix is a circu- 
lant matrix; that is, the rows are circular shifts of one another. 

circumference: The circumference of a graph is the length of its longest cycle. 

clique: A clique is a set S of vertices for which the induced subgraph G[S] is 
complete. 

clique number: The clique number w(G) of a graph G is the largest cardinality of 
a clique in G. 

coboundary operator: The coboundary operator for a graph is the linear mapping 
from 0-chains (elements of the vertex space) to 1-chains (elements of the edge 
space) that sends each vertex to the indicator mapping of the set of edges 
incident with it. 
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cocycle vector: A cut vector is sometimes called a cocycle vector. 

coloring: A partition of the vertex set of a graph is called a coloring, and the 
blocks of the partition are called color classes. A coloring with k color classes 
is called a k-coloring. A coloring is proper if no two adjacent vertices belong 
to the same color class. See also chromatic number and chromatic polynomial. 

complement: The complement G of a graph G = (V, E) has vertex set V and 
edge set (^) \ E; that is, its edges are exactly the pairs of vertices that are not 
edges of G. 

complete graph: A graph is complete if every pair of distinct vertices is an edge; 
K n denotes a complete graph with n vertices. 

component: A component of a graph is a maximal connected subgraph. 

connectedness: A graph is said to be connected if each pair of vertices is joined by 
a walk; otherwise, the graph is disconnected. A graph is k-connected if it has 
order at least k + 1 and each pair of vertices is joined by k pairwise internally 
disjoint paths. 

connectivity: The connectivity k(G) of G is the largest k for which G is k- 
connected. 

contraction: To contract an edge {v, w} of a graph G is to construct a new graph 
G' from G by removing the edge {v,w} and identifying the vertices v and w. 
A graph G is contractible to a graph HUH can be obtained from G via the 
contraction of one or more edges of G. 

cover: A set 5 C V is a vertex cover if every edge of G is incident with some 
vertex in S. A set T C E is an edge cover of a graph G = (V, E) if each 
vertex of G is incident to at least one edge in T. 

crosscap number: The crosscap number 7(G) of a graph G is the least g for which 
G has an embedding in a non-orientable surface obtained from the sphere by 
adding g crosscaps. See also genus. 

crossing: A crossing is a point lying in images of two edges of a drawing of a 
graph on a surface. 

crossing number: The crossing number v(G) of a graph G is the minimum num- 
ber of crossings among all drawings of G in the plane. The rectilinear cross- 
ing number v{G) of a graph G is the minimum number of crossings among all 
drawings of G in the plane for which the image of each edge is a straight line 
segment. 

cubic: A graph is a cubic graph if it is regular of degree 3. 

cut: For each partition V = V\ l±) V2 of the vertex set of a graph G = (V, E) into 
two disjoint blocks, the set of all edges joining a vertex in V\ to a vertex in V 2 
is called a cut. 
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cut space: The cut space of a graph G is the subspace of the edge space of G 
spanned by the cut vectors. 



cut vector: The cut vector corresponding to a cut C of a graph G = (V, E) is the 
mapping v : E — > GF(2) in the edge space of G 



cut vertex: A cut vertex of a connected graph is a vertex whose removal, along 
with all edges incident with it, leaves a disconnected graph. 

cycle: A cycle is a circuit, each pair of whose vertices other than the rst and the 
last are distinct. 

cycle space: The cycle space of a graph G is the subspace of the edge space of G 
consisting of all 1-chains with boundary 0. An indicator mapping of a set of 
edges with which each vertex is incident an even number of times is called a 
cycle vector. The cycle space is the span of the cycle vectors. 

degree: The degree deg a; of a vertex a; in a graph is the number of vertices adja- 
cent to it. The maximum and minimum degrees of vertices in a graph G are 
denoted A(G) and 6(G), respectively. 

degree sequence: A sequence (di , . . . , d n ) is a degree sequence of a graph if there 
is some ordering v\ , . . . , v n of the vertices for which is the degree of Vi for 



diameter: The diameter of G is the maximum distance between two vertices of G; 
thus it is also the maximum eccentricity of a vertex in G. 

digraph: A digraph is a directed graph; one in which each edge has a direction. 

distance: The distance d(u, v) between vertices u and v in a graph G is the mini- 
mum among the lengths of u, w-paths in G, or oo if there is no u, v-path. 

drawing: A drawing of a graph G in a surface S consists of a one-to-one mapping 
from the vertices of G to points of S and a one-to-one mapping from the edges 
of G to open arcs in X so that (i) no image of an edge contains an image of 
some vertex, (ii) the image of each edge {v, w} joins the images of v and w, 
(iii) the images of adjacent edges are disjoint, (iv) the images of two distinct 
edges never have more than one point in common, and (v) no point of the 
surface lies in the images of more than two edges. 

eccentricity: The eccentricity ecc(x) of a vertex a; in a graph G is the maximum 
distance from a; to a vertex of G. 

edge connectivity: The edge connectivity of G, denoted A(G), is the minimum 
number of edges whose removal results in a disconnected graph. 




e G G, 



otherwise. 



(3.4.4) 



each i. 
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edge space: The edge space of a graph G = (V, E) is the vector space of all 
mappings from E to the two-element eld GF(2). Elements of the edge space 
are called 1-chains. 

embedding: An embedding of a graph G in a topological space X consists of an 
assignment of the vertices of G to distinct points of X and an assignment of 
the edges of G to disjoint open arcs in X so that no arc representing an edge 
contains some point representing a vertex and so that each arc representing an 
edge joins the points representing the vertices incident with the edge. See also 
drawing. 

end vertex: A vertex of degree 1 in a graph is called an end vertex. 

Eulerian circuits and trails: A trail or circuit that includes every edge of a graph 
is said to be Eulerian, and a graph is Eulerian if it has an Eulerian circuit. 

even: A graph is even if the degree of every vertex is even. 

factor of a graph: A. factor of a graph G is a spanning subgraph of G. A factor in 
which every vertex has the same degree k is called a fc-factor. If G \ , G2, 
Gk (k > 2) are edge-disjoint factors of the graph G, and if IJi=i E(Gi) = 
E(G), then G is said to be factored into G\, G 2 , ...,Gu and we write G = 

Gi®G 2 ®---®G k . 

forest: A forest is an acyclic simple graph; see also tree. 

genus: The genus 7(G) (plural form genera) of a graph G is the least g for which 
G has an embedding in an orientable surface of genus g. See also crosscap 
number. 

girth: The girth gir(G) of a graph G is the minimum length of a cycle in G, or 00 
if G is acyclic. 

Hamiltonian cycles and paths: A path or cycle through all the vertices of a graph 
is said to be Hamiltonian. A graph is Hamiltonian if it has a Hamiltonian 
cycle. 

homeomorphic graphs: Two graphs are homeomorphic to one another if there is 
a third graph of which each is a subdivision. 

identification of vertices: To identify vertices v and w of a graph G is to construct 
a new graph G' from G by removing the vertices v and w and all the edges 
of G incident with them and introducing a new vertex u and new edges joining 
u to each vertex that was adjacent to v or to w in G. See also contraction. 

incidence: A vertex v and an edge e are incident with one another if i; € e. 

incidence matrix: For an ordering v\ , v 2 , ■ ■ ■ , v n of the vertices and an ordering 
ei, e2, . . . , e m of the edges of a graph G = (V, E) with order \G\ = n and 



© 2003 by CRC Press LLC 



FIGURE 3.2 

Three graphs that are isomorphic. 





size e(G) = m, there is a corresponding n x m incidence matrix B = (6y) 
de ne d as follows: 



1 , if Vi and ej are incident, 
0, otherwise. 



(3.4.5) 



independence number: The independence number a(G) of a graph G = (V, E) 
is the largest cardinality of an independent subset of V . 

independent set: A set 5 C V is said to be independent if the induced sub- 
graph G[S] is empty. See also matching. 

internally disjoint paths: Two paths in a graph with the same initial vertex v 
and terminal vertex w are internally disjoint if they have no internal vertex in 
common. 

isolated vertex: A vertex is isolated if it is adjacent to no other vertex. 

isomorphism: An isomorphism between the two graphs G = (Vq, Eq) and H = 
(Vh,Eh) is a bijective mapping if) : Vq — > Vh f° r which {x, y} £ Eq if and 
only if {ip(x),ip(y)} G Eh- If there is an isomorphism between G and H, 
then G and H are said to be isomorphic to one another; this is denoted as 
G — H. Figure 3.2 contains three graphs that are isomorphic. 

labeled graph: Graph theorists sometimes speak loosely of labeled graphs of 
order n and unlabeled graphs of order n to distinguish between graphs with 
a x ed vertex set of cardinality n and the family of isomorphism classes of 
such graphs. Thus, one may refer to labeled graphs to indicate an intention to 
distinguish between any two graphs that are distinct (i.e., have different vertex 
sets and/or different edge sets). One may refer to unlabeled graphs to indicate 
the intention to view any two distinct but isomorphic graphs as the 'same' 
graph, and to distinguish only between non-isomorphic graphs. 

matching: A matching in a graph is a set of edges, no two having a vertex in 
common. A maximal matching is a matching that is not a proper subset of any 
other matching. A maximum matching is a matching of greatest cardinality. 
For a matching M, an M-alternating path is a path whose every other edge 
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belongs to M, and an M -augmenting path is an M-alternating path whose rst 
and last edges do not belong to M. A matching saturates a vertex if the vertex 
belongs to some edge of the matching. 

monotone graph property: A property V that a graph may or may not enjoy is 
said to be monotone if, whenever H is a graph enjoying V, every supergraph G 
of H with |G| = \H\ also enjoys V. 

multipartite graph: A graph is k-partite if its vertex set can be partitioned into k 
disjoint sets called color classes in such a way that every edge joins vertices 
in two different color classes (see also coloring). A two-partite graph is called 
bipartite. 

neighbor: Adjacent vertices v and w in a graph are said to be neighbors of one 
another. 

neighborhood: The sphere S(x, 1) is called the neighborhood of x, and the 
ball B(x, 1) is called the closed neighborhood of x. 

order: The order \G\ of a graph G = (V, E) is the number of vertices in G; in 
other words, \G\ = \V\. 

path: A path is a walk whose vertices are distinct. 

perfect graph: A graph is perfect if x(H) = ^(H) for all induced subgraphs H 
ofG. 

planarity: A graph is planar if it has a proper embedding in the plane. 

radius: The radius rad(G) of a graph G is the minimum vertex eccentricity in G. 

regularity: A graph is k-regular if each of its vertices has degree k. A graph is 
strongly regular with parameters (k, A, p) if (i) it is A; -regular, (ii) every pair of 
adjacent vertices has exactly A common neighbors, and (iii) every pair of non- 
adjacent vertices has exactly p common neighbors. A graph G = (V, E) of 
order \G\ > 3 is called highly regular if there exists annxn matrix C = (cy), 
where 2 < n < \G\, called a collapsed adjacency matrix, so that, for each 
vertex v of G, there is a partition of V into n subsets V\ = {v}, Vi , . . . , V n so 
that every vertex y € Vj is adjacent to exactly Cy vertices in Vj. Every highly 
regular graph is regular. 

rooted graph: A rooted graph is an ordered pair (G, v) consisting of a graph G 
and a distinguished vertex v of G called the root. 

self-complementary: A graph is self-complementary if it is isomorphic to its com- 
plement. 

similarity: Two vertices u and v of a graph G are similar (in symbols u ~ v) if 
there is an automorphism a of G for which a(u) = v. Similarly, two edges 
(u, v) and (a, b) in the graph G are similar if an automorphism a of G exists 
for which {a(u),a(v)} = {a, b}. 
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size: The size e(G) of a graph G = (V, E) is the number of edges of G, that is, 
e(G) = \E\. 

spectrum: The spectrum of a graph G is the spectrum of its characteristic polyno- 
mial, i.e., the non-decreasing sequence of \G\ eigenvalues of the characteristic 
polynomial of G. Since adjacency matrices are real symmetric, their spectrum 
is real. 

sphere: The sphere of radius k about a vertex u is the set 

S(u,k) = {v G V | d{u,v) = k}. (3.4.6) 

See also ball and neighborhood. 

subdivision: To subdivide an edge {v, w} of a graph G is to construct a new graph 
G 1 from G by removing the edge {v, w} and introducing new vertices x , and 
new edges {v,x\}, {x^, w} and {.;•,..;•, . < j for 1 < i < k. A subdivision of a 
graph is a graph obtained by subdividing one or more edges of the graph. 

subgraph: A graph H = (Vh, E h ) is a subgraph of a graph G = (Vg,E g ) (in 
symbols, H -< G), if Vh Q Vq and Eh Q Eq. In that case, G is a supergraph 
of i? (in symbols, G y H). If Vjj = Vq, then is called a spanning subgraph 
of G. For each set S C Vg, the subgraph G[S] of G induced by 5 is the unique 
subgraph of G with vertex set S for which every edge of G incident with two 
vertices in S is also an edge of G[S]. 

symmetry: A graph is vertex symmetric if every pair of vertices is similar. A graph 
is edge symmetric if every pair of edges is similar. A graph is symmetric if it 
is both vertex and edge symmetric. 

2-switch: For vertices v,w,x,y in a graph G for which {v,w} and {x,y} are 
edges, but {v,y} and {x, w} are not edges, the construction of a new graph G ' 
from G via the removal of edges {v, w} and {x, y} together with the insertion 
of the edges {v, y} and {x, w} is called a 2-switch. 

thickness: The thickness 9(G) of a graph G is the least k for which G is a union 
of k planar graphs. 

trail: A trail in a graph is a walk whose edges are distinct. 

tree: A tree is a connected forest, i.e., a connected acyclic graph. A spanning 
subgraph of a graph G that is a tree is called a spanning tree of G. 

triangle: A 3-cycle is called a triangle. 

trivial graph: A trivial graph is a graph with exactly one vertex and no edges. 

unicyclic graph: A unicyclic graph is a connected graph that contains exactly one 
cycle. 

vertex space: The vertex space of a graph G is the vector space of all mappings 
from V to the two-element eld GF(2). The elements of the vertex space are 
called 0-chains. 
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walk: A walk in a graph is an alternating sequence vq , e\ , v\ , . . . , , Vk of ver- 
tices Vi and edges e, for which e, is incident with Vi-i and with Vi for each i. 
Such a walk is said to have length k and to join vo and vu- The vertices vq 
and Vk are called the initial vertex and terminal vertex of the walk; the remain- 
ing vertices are called internal vertices of the walk. 



3.4.3 CONSTRUCTIONS 
3.4.3.1 Operations on graphs 

For graphs G\ = (Vi,E\) and G 2 = (V 2 , E2), there are several binary operations 
that yield a new graph from G\ and G2 . The following table gives the names of some 
of those operations and the orders and sizes of the resulting graphs. 



Operation producing G 


Order |G| 


Size e(G) 


Composition 


Gi[G 2 ] 


|Gi|-|G 2 | 


|G 1 |e(G 2 ) + |G 2 | 2 e(G 1 ) 


Conjunction 


Gi AG 2 


|Gi|-|G 2 | 




Edge sum" 


Gi ©G 2 


|Gi| = |G 2 | 


< (e(Gi)+e(G 2 )) 


Join 


Gi +G 2 


|Gi| + |G 2 | 


e(G 1 )+e(G 2 ) + |G 1 |-|G 2 | 


Product 


Gi x G 2 


|Gi|-|G 2 | 


|G 1 |e(G 2 ) + |G 2 |e(G 1 ) 


Union 


Gi UG 2 


|Gi| + |G 2 | 


e(Gi)+e(G 2 ) 



"When applicable. 

composition: For graphs Gi = ( V\ , E\ ) and G 2 = (V 2 , B 2 ), the composition 
G = Gi [G 2 ] is the graph with vertex set Vi x V 2 whose edges are (1) the pairs 
(u,w)} withu € Vi and{w,w} € i? 2 and (2) the pairs {(t, u), (v,w)} 
for which {t,v} G E\. 

conjunction: The conjunction G\ A G 2 of two graphs Gi = (Vi , E\) and G 2 = 

(V 2 , B 2 ) is the graph G3 = (V3, S3) for which V3 = Vi x V 2 and for which 
vertices d = (ui , u 2 ) and e 2 = (v\ , w 2 ) in V3 are adjacent in G3 if, and only 
if, u\ is adjacent to v\ in G\ and u 2 is adjacent to w 2 in G 2 . 

edge difference: For graphs G 1 = (V, i?i ) and G 2 = ( V, i? 2 ) with the same vertex 
set V, the edge difference G\ — G 2 is the graph with vertex set V and edge set 
Ei \ E2 . 

edge sum: For graphs Gi = (V, Ei) and G 2 = (V,E 2 ) with the same vertex 
set V, the edge sum of Gi and G 2 is the graph G\ ffi G 2 with vertex set V and 
edge set E\ U E 2 . Sometimes the edge sum is denoted G\ U G 2 . 

join: For graphs G\ = {V\,Ei) and G 2 = (V 2 , i? 2 ) with Vi PI V 2 = 0, the yo/w 
Gi + G 2 = G 2 + Gi is the graph obtained from the union of G\ and G 2 by 
adding edges joining each vertex in V\ to each vertex in V2 . 

power: For a graph G = (V, E), the A;* power G k is the graph with the same 
vertex set V whose edges are the pairs {u, v} for which d(u, v) < k in G. The 
square of G is G 2 . 



© 2003 by CRC Press LLC 



product: For graphs Gi = ( V\ , E\ ) and G 2 = (V 2 , £ 2 ), the product G\ x G 2 has 
vertex set Vi x V 2 ; its edges are all of the pairs {(u,v), (u,w)} for which u G 
Vi and {v, w} G £? 2 and all of the pairs {(t, v), (u, v)} for which {t, u} G E\ 
and v G V 2 . 

union: For graphs Gi = (Vi,Ei) and G 2 = (V 2 ,i£ 2 ) with V\ n V 2 = 0, the 
«nion of Gi and G 2 is the graph Gi U G 2 = (Vi U V 2 , £1 U B 2 ). The union 
is sometimes called the disjoint union to distinguish it from the edge sum. 

3.4.3.2 Graphs described by one parameter 

complete graph, K n : A complete graph of order n is a graph isomorphic to the 
graph K n with vertex set {1, 2, . . . , n} whose every pair of vertices is an edge. 
The graph K n has size (™) and is Hamiltonian. If G is a graph g of order n, 
then K n = G®G. 

cube, Q n : An n-cube is a graph isomorphic to the graph Q n whose vertices are 
the 2™ binary n-vectors and whose edges are the pairs of vectors that differ in 
exactly one place. It is an n-regular bipartite graph of order 2 " and size n2 n ~ 1 . 
An equivalent recursive de nition ,Q\ = K 2 and Q n = Q n -i x K 2 . 

cycle, C„ : A cycle of order n is a graph isomorphic to the graph G„ with vertex 
set {0, 1, . . . , n — 1} whose edges are the pairs {vt, } with < i < n and 
arithmetic modulo n. The cycle C„ has size n and is Hamiltonian. 

The graph G„ is a special case of a circulant graph. The graph G3 is called a 
triangle; the graph C\ is called a square. 

empty graph: A graph is empty if it has no edges; K n denotes an empty graph of 
order n. 

Kneser graphs, : For n > 2m, the Kneser graph is the complement 

of the intersection graph of the m-subsets of an n-set. The odd graph O m is 
the Kneser graph K^ +1 . The Petersen graph is the odd graph 2 = . 

ladder: A ladder is a graph of the form P n x P 2 . The Mobius ladder M n is the 
graph obtained from the ladder P n x P 2 by joining the opposite end vertices 
of the two copies of P n . 

path, P n : A path of order n is a graph isomorphic to the graph P n whose vertex 
set is {1, ... ,n} and whose edges are the pairs {v^, Wj+i} with 1 < i < n. A 
path of order n has size n — 1 and is a tree. 

star, S n : A star of order n is a graph isomorphic to the graph S n = K\ yTl . It has 
a vertex cover consisting of a single vertex, its size is n, and it is a complete 
bipartite graph and a tree. 

wheel, W n : The wheel W n of order n > 4 consists of a cycle of order n — 1 
and an additional vertex adjacent to every vertex in the cycle. Equivalently, 
W n = G„_i + K\. This graph has size 2(n - 1). 
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3.4.3.3 Graphs described by two parameters 

complete bipartite graph, K n ^ m : The complete bipartite graph K n ^ m is the 
graph K„ + K m . Its vertex set can be partitioned into two color classes of 
cardinalities n and m, respectively, so that each vertex in one color class is ad- 
jacent to every vertex in the other color class. The graph K n ^ m has order n+m 
and size nm. 

planar mesh: A graph of the form P n x P m is called a planar mesh. 
prism: A graph of the form C m x P n is called a prism. 

Toeplitz graph, TN(w, s): The Toeplitz graph TN(w, s) is de ned in terms of its 
adjacency matrix A = (oy), for which 



The Toeplitz graph is of order ws + 2, size (s + l)(w — s + 2) /2, and girth 3 
or 4; it is (s + l)-regular and Hamiltonian. Moreover, TN(1, s) = K s+2 and 
TN(w, 1) = C w+2 . 

toroidal mesh: A graph of the form C m x C„ with m > 2 and n > 2 is called a 
toroidal mesh. 

Turan graph, T n ^\ The Turdn graph T n ^ is the complete A;-partite graph in 
which the cardinalities of any two color classes differ by, at most, one. It has 
n — k [n/k\ color classes of cardinality [n/k\ +1 and k — n + k[n/k\ color 
classes of cardinality [n/k\ . Note that w(T„^) = k. 

3.4.3.4 Graphs described by three or more parameters 

Cayley graph: For a group V and a set X of generators of T, the Cayley graph 
of the pair (T, X) is the graph with vertex set T in which {a, /?} is an edge if 
either a -1 /? G X or ^~ l a G X. 

complete multipartite graph, K nitm ^ ^ nh : The complete k -partite graph 

Kn 1 ,n 2 ,...,n k is the graph K ni H h K nk . It is a a A; -partite graph with color 

classes Vi of cardinalities |V,| = n, for which every pair of vertices in two 
distinct color classes is an edge. The graph ^ m ,n 2 ,..., nt! has order Yli=i n k 



double loop graph, DLG(n; a,b): The double loop graph DLG(n; a, b) (with a 
and b between 1 and (n — 1) /2) consists of n vertices with every vertex i con- 
nected by an edge to the vertices i ± a and i ± b (modulo n). The name comes 
from the following fact: If GCD(a, b, n) = 1, then DLG(n; a, b) is Hamilto- 
nian and, additionally, DLG(n; a, b) can be decomposed into two Hamiltonian 
cycles. These graphs are also known as circulant graphs. 




1, — j\ = 1 (mod w), 
0, otherwise. 



(3.4.7) 



and size ^2 



\<i<j<k n i n 3- 
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FIGURE 3.3 

Examples of graphs with 6 or 7 vertices. 




intersection graph: For a family F = {S\, . . . , £„} of subsets of a set S, the 

intersection graph of F is the graph with vertex set F in which {5,:, Sj} is an 
edge if and only if 5, CiSj ^ 0. Each graph G is an intersection graph of some 
family of subsets of a set of cardinality at most [|G| 2 /4j . 

interval graph: An interval graph is an intersection graph of a family of intervals 
on the real line. 



3.4.4 FUNDAMENTAL RESULTS 
3.4.4.1 Walks and connectivity 

1. Every x, y walk includes all the edges of some x, y path. 

2. Some path in G has length 5(G). 

3. Connectivity is a monotone graph property. If more edges are added to a 
connected graph, the new graph is itself connected. 

4. A graph is disconnected if, and only if, it is the union of two graphs. 

5. The sets S for which G[S] is a component partition of the vertex set V. 
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6. Every vertex of a graph lies in at least one block. 

7. For every graph G, < k(G) < \G\ - 1. 

8. For all integers a, b, c with < a < b < c, a graph G exists with k(G) = a, 
A(G) = b, and 6(G) = c. 

9. For any graph G, k(G) < X(G) < 6(G). 

10. Menger's theorem: Suppose that G is a connected graph of order greater 
than k. Then G is ^-connected if, and only if, it is impossible to disconnect G 
by removing fewer than k vertices, and G is A;-edge connected if, and only if, 
it is impossible to disconnect G by removing fewer than k edges. 

11. If G is a connected graph with a bridge, then A(G) = 1. If G has order n and 
is r-regular with r > n/2, then A(G) = r. 



3.4.4.2 Trees 

1. A graph is a tree if, and only if, it is acyclic and has size \G\ — 1. 

2. A graph is a tree if, and only if, it is connected and has size \G\ — 1. 

3. A graph is a tree if, and only if, each of its edges is a bridge. 

4. A graph is a tree if, and only if, each vertex of degree greater than 1 is a cut 
vertex. 

5. A graph is a tree if, and only if, each pair of its vertices is joined by exactly 
one path. 

6. Every tree of order greater than 1 has at least two end vertices. 

7. The center of a tree consists of one vertex or two adjacent vertices. 

8. For each graph G, every tree with at most 6(G) edges is a subgraph of G. 

9. Every connected graph has a spanning tree. 

10. Kirchhoff matrix-tree theorem: Let G be a connected graph and let A be an ad- 
jacency matrix for G. Obtain a matrix M from — A by replacing each term a u 
on the main diagonal with degw,. Then all cofactors of M have the same 
value, which is the number of spanning trees of G. 

11. Nash-Williams arboricity theorem: For a graph G and for each n < |G|,dene 
e„(G) = max{e(H) :H<G, and \H\ = n} . Then 

T(G) = max . (3.4.8) 
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3.4.4.3 Circuits and cycles 

1. Euler's theorem: A multigraph is Eulerian if and only if it is connected and 
even. 

2. If G is Hamiltonian, and if G' is obtained from G by removing a non-empty 
set S of vertices, then the number of components of G 1 is at most \S\. 

3. Ore's theorem: If G is a graph for which Aegv + degw > \G\ whenever v 
and w are non-adjacent vertices, then G is Hamiltonian. 

4. Dirac's theorem: If G is a graph of order \G\ > 3 and deg v > \G\/2 for each 
vertex v, then G is Hamiltonian. 

5. (Erdos-Chvatal) If a(G) < k(G), then G is Hamiltonian. 

6. Every 4-connected planar graph is Hamiltonian. 

7. The following table tells which members of several families of graphs are 
Eulerian or Hamiltonian: 



graph 


Is it Eulerian? 


Is it Hamiltonian? 


B n 


yes 


yes, for n > 1 


C n 


yes 


yes, for n > 1 


D n 


yes, for n even 


yes, for n > 2 


K n 


yes, for odd n 


yes, for n > 3 


K 


yes, for to and n both even 


yes, for to = n 


Qn 


yes, for n even 


yes, for n > 2 


w n 


no 


yes, for n > 2 



3.4.4.4 Cliques and independent sets 

1 . A set S C V is a vertex cover if, and only if, V \ S is an independent set. 

2. Turdn's theorem: If \G\ = n and oj(G) < k, then e(G) < e(T„^). 

3. Ramsey's theorem: For all positive integers k and /, there is a least inte- 
ger R(k, I) for which every graph of order at least R(k, I) has either a clique 
of cardinality k or an independent set of cardinality I. For k > 2 and I > 2, 
R(k, I) < R(k, l -l) + R(k - 1, 0- 



R(k,l) 


/ = 1 


2 


3 


4 


5 


6 


7 


k = 1 


1 


1 


1 


1 


1 


1 


1 


2 


1 


2 


3 


4 


5 


6 


7 


3 


1 


3 


6 


9 


14 


18 


23 
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3.4.4.5 Colorings and partitions 

1. Every graph G is fc-partite for some k; in particular, G is \G\ -partite. 

2. Every graph G has a bipartite subgraph H for which e(H) > e(G) /2. 

3. P G (x) =P G - e (x) -P G \e(x). 

4. Brooks' theorem: If G is a connected graph that is neither a complete graph 
nor a cycle of odd length, then x(G) < A(G). 

5. For all positive integers g and c, a graph G exists with x(G) > c and gir(G) > 
9- 

6. Nordhaus-Gaddum bounds: For every graph G, 

^VW\<X(G)+X(G) < \G\ + 1, and 

|G| < x(G) X (G) < ( i ^ tl ) • 

7. Szekeres-Wilf theorem: For every graph G = (V, E), 

X (G)<l + rnax<5(G[5]). 

8. (Konig) If G is bipartite, then x'(G) = A(G). 

9. Vizing's theorem: For every graph G, A(G) < x'(G) < A(G) + 1. 

10. The following table gives the chromatic numbers and chromatic polynomials 
of various graphs: 



G 


X(G) 




K n 


n 


a;(a; — 1) • • • (x — n + 1) 


K n 


1 


x n 


T n 


2 


x(x - I)™" 1 


Pn 


2 


x(x - I)™" 1 


G 4 


2 


x(x - l)(x 2 - 3x + 3) 



11. The following table gives the chromatic numbers and edge-chromatic numbers 
of various graphs: 



G 


X(G) 


Xi(G) 


G„ with n even, n > 2 


2 


2 


G„ with n odd, n > 3 


3 


3 


X n with n even, n > 2 


n 


n — 1 


7f„ with n odd, n > 3 


n 


n 


^m,n with TO, n > 1 


2 


mas(m, n) 


^m,,..,m, withTOj > 1 


fc 


max(TOi , • • • , TOfc) 


Pn 


2 


2 


Petersen graph 


3 


4 


W n with n even, n > 2 


3 


n 


W„ with n odd, n > 3 


4 


n 
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12. (Appel-Haken) Four-color theorem: x(G) < 4 for every planar graph G. 

13. For each graph G of order \G\ = n and size e(G) = m with exactly k compo- 
nents, the chromatic polynomial is of the form 

n—k 

P G W = ^(-l) 1 a ! /- 1 , (3.4.9) 

with a = 1> o-i = m ar >d every a, positive. 

14. Not every polynomial is a chromatic polynomial. For example P(x) = x 4 — 
4x 3 + 3x' 2 is not a chromatic polynomial. 

15. Sometimes a class of chromatic polynomials can only come from a speci c 
class of graphs. For example: 

(a) If P G {x) = x n , then G = K n . 

(b) If P G (x) = (x) n , then G = K n . 

(c) If Pg(x) = x(x-l) ■ ■ ■ (x-r + 2)(x-r + l) 2 (x-r) n ~ r ~ 1 for a graph 
of order n > r + 1, then G can be obtained from an r-tree T of order n 
by deleting an edge contained in exactly r — 1 triangles of T. 



3.4.4.6 Distance 

1. A metric space (X, d) is the metric space associated with a connected graph 
with vertex set X if, and only if, it satis es two conditions: (i) d(u, v) is a non- 
negative integer for all u, v € X, and (ii) whenever d(u, v) > 2, some element 
of X lies between u and v. The edges of the graph are the pairs {u, v} C X 
for which d(u, v) = 1. (In an arbitrary metric space (X, d), a point u g lis 
said to lie between distinct points u £ X and w € X if it satis es the triangle 
equality d(u, w) = d(u, v) + d(v, w).) 

2. If G = (V, E) is connected, then distance is always nite, and d is a metric 
onV. Note that deg(a;) = |S(x,l)|. 

3. Moore bound: For every connected graph G, 

diam(G) 

|G|<1 + A(G) J2 ( A (G)-1Y- (3.4.10) 

i=l 

A graph for which the Moore bound holds exactly is called a Moore graph 
with parameters (| G|, A (G), diam(G)). Every Moore graph is regular. If G 
is a Moore graph with parameters (n, r, d), then (n, r, d) = (n, n — 1, 1) (in 
which case G is complete), (n, r, d) = (2m +1,2, m) (in which case G is a 
(2m + l)-cycle), or (n, r, d) G {(10, 3, 2), (50, 7, 2), (3250, 57, 2)}. 
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3.4.4.7 Drawings, embeddings, planarity, and thickness 

1. Every graph has an embedding in K 3 for which the arcs representing edges 
are all straight line segments. Such an embedding can be constructed by using 
distinct points on the curve {(t,t 2 ,t 3 ) : < t < 1} as representatives for the 
vertices. 



2. For n > 2, 



3. Forr, s > 2, 



4. Forn > 3, 



l{K n ) -- 
l{K n ) -- 



[n — 
[n — 


4)2™" 3 
4)2™" 2 


+ 1, 
+ 2. 


Ur 


-2)( S - 


-2)1 


"(r 


4 

-2)( a - 


-2) _ 




2 




(n 


-3)(n- 


-4)1 


(n 


12 

-3)(n- 


-4)" 


6 



(3.4.11) 



and 



(3.4.12) 



, and 



(3.4.13) 



5. Heawood map coloring theorem: The greatest chromatic number among graphs 
of genus n is 



max{ X (G) | 7 (G) = n} 



7 + VI + 48n 



6. Kuratowski's theorem: A graph is planar if and only if it has no subgraph 
homeomorphic to K 5 or K 3:3 . 

7. A graph is planar if and only if it does not have a subgraph contractible to K 5 

or ^3,3- 

8. The graph K n is non-planar if and only if n > 5. 

9. Every planar graph can be embedded in the plane so that every edge is a 
straight line segment; this is a Fary embedding. 

10. The four-color theorem states that any planar graph is four colorable. 

11. For every graph G of order \G\ > 3, 6(G) > -^ff - 

12. The complete graphs K 9 and K w have thickness 3; for n ^ {9, 10}, 

' n + 7 ' 



0(K n ) 



6 



(3.4.14) 
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13. The n-cube has thickness 6{Q n ) 

14. For every planar graph G, v(G) 
graphs: v{K%) = 18, and T7(Kg) 



[n/4\ + 1. 

v{G). That equality does not hold for all 
19. 



3.4.4.8 Vertex degrees 

1. Handshaking lemma: For every graph G, 2~2vev degv = 2e(G). 

2. Every 2-switch preserves the degree sequence. 

3. If G and H have the same degree sequence, then H can be obtained from G 
via a sequence of 2-switches. 

4. Havel theorem: The values {d\ , di , . . . , d n } with d\ > d<i > ■ ■ ■ > d n > 
are a degree sequence if and only if the sequence obtained by deleting d \ and 
subtracting 1 from each of the next d\ largest values (i.e., {d% — 1, d$ — 1, . . . , 
dd 1+ i — 1, dd 1+ 2, ■ ■ ■ , d n }) is a degree sequence. 



3.4.4.9 Algebraic methods 

1. The bipartite graphs K n ^ n are circulant graphs. 

2. For a graph G with exactly k connected components, the cycle space has di- 
mension e(G) — \G\ + k, and the cut space has dimension \G\ — k. 

3. In the k lh power A k = (afj) of the adjacency matrix, each entry a *■ is the 
number of Vi , vj walks of length k. 

4. The incidence matrix of a graph G is totally unimodular if, and only if, G is 
bipartite. 

5. Every odd graph is vertex-transitive. 

6. The smallest graph that is vertex symmetric, but is not edge symmetric, is the 
prism K 3 x K 2 . The smallest graph that is edge symmetric, but is not vertex 
symmetric, is S2 = P3 = ^1,2- 

7. The spectrum of a disconnected graph is the union of the spectra of its compo- 
nents. 

8. The sum of the eigenvalues in the spectrum of a graph is zero. 

9. The number of distinct eigenvalues in the spectrum of a connected graph is 
greater than the diameter of the graph. 

10. The largest eigenvalue in the spectrum of a graph G is, at most, A(G), with 
equality if, and only if, G is regular. 
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11. (Wilf) If G is a connected graph and its largest eigenvalue is A, then x(G) < 
1 + A. Moreover, equality holds if, and only if, G is a complete graph or a 
cycle of odd length. 

12. (Hoffman) If G is a connected graph of order n with spectrum A i > • • • > A„, 
thenx(G) > 1-Ai/A„. 

13. Integrality condition: If G is a strongly regular graph with parameters (k, A,/i), 
then the quantities 

I ( ]Gl _ 1 ± (\G\-l)(p-\)-2k 

are non-negative integers. 

14. The following table gives the automorphism groups of various graphs: 



G 


Aut(G) 


G n 


D n 


Kn 


Sn 


K n 


Sn 


K\,n 


El + S n 


Pn 


G n 



15. A graph and its complement have the same group, Aut(G) = Aut(G). 

16. Frucht's theorem: Every nite group is the automorphism group of some 
graph. 

17. If G and G' are edge isomorphic, then G and G' are not necessarily required 
to be isomorphic. For example, the graphs G3 and 53 are edge isomorphic, but 
not isomorphic. 

18. If the graph G has order n, then the order of its automorphism group |Aut(G) | 
is a divisor of n\. The order of the automorphism group equals n\ if and only 
ifG~^„orG~F„. 

3.4.4.10 Matchings 

1 . A matching M is a maximum matching if, and only if, there is no M-augmenting 
path. 

2. Hall's theorem: A bipartite graph G with bipartition (P>i , B2) has a matching 
that saturates every vertex in B\ if, and only if, \S(A, 1)| > \A\ for every 
ACBl 

3. Konig's theorem: In a bipartite graph, the cardinality of a maximum matching 
equals the cardinality of a minimum vertex cover. 



(3.4.15) 
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3.4.4.11 Enumeration 

1 . The number of labeled graphs of order n is 2 

GO 

2. The number of labeled graphs of order n and size m is (^). 

3. The number of different ways in which a graph G of order n can be labeled is 
n!/|Aut(G)|. 

4. Cayley's formula: The number of labeled trees of order n is n n ~ 2 . 

5. The number of labeled trees of order n with exactly t end vertices is 

^S{n — 2, n — t) for 2 < f < n — 1 (where 5(, ) is a Stirling number of the 
second kind). 

6. The following table lists the number of graphs, number of digraphs, number 
of trees (t„), number of rooted trees (T„), of different orders. 



Order 


Graphs 


Digraphs 


Trees (t n ) 


Rooted trees (T„) 


1 


1 


1 


1 


1 


2 


2 


3 


1 


1 


3 


4 


16 


1 


2 


4 


11 


218 


2 


4 


5 


34 


9608 


3 


9 


6 


156 


1540944 


6 


20 


7 


1044 


882033440 


11 


48 


8 


12346 


1793359192848 


23 


115 


9 


274668 




47 


286 


10 


12005168 




106 


719 



7. Dene the generating functions T (a;) — y"l^_ n T n x " andi(a;) = E^o^™- 
ThenTOr) =xexp (£?=i $T (x r )) ,andt{x) = T{x)-\ [T 2 (x) - T (x 2 )] . 

8. The following table lists the number of isomorphism classes of graphs of or- 
der n and size m. 



m 


n = 1 


2 


3 


4 


5 


6 


7 


8 


9 





1 


1 


1 


1 


1 


1 


1 


1 


1 


1 




1 


1 


1 


1 


1 


1 


1 


1 


2 






1 


2 


2 


2 


2 


2 


1 


3 






1 


3 


4 


5 


5 


5 


5 


4 








2 


6 


9 


10 


11 


11 


5 








1 


6 


15 


21 


24 


25 


6 








1 


6 


21 


41 


56 


63 


7 










4 


24 


65 


115 


148 


8 










2 


24 


97 


221 


345 


9 










1 


21 


131 


402 


771 


10 










1 


15 


148 


663 


1637 
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TYl 


n=123456 


7 


8 


9 


11 


9 


148 


980 


3252 


12 


5 


131 


1312 


5995 


13 


2 


97 


1557 


10120 


14 


1 


65 


1646 


15615 


15 


1 


41 


1557 


21933 


16 




21 


1312 


27987 


17 




10 


980 


32403 


18 




5 


663 


34040 



9. The following table lists the number of isomorphism classes of digraphs with 
n vertices and to arcs. 



TO 


n = 1 


2 


3 


4 


5 





1 


1 


1 


1 


1 


1 




2 


6 


12 


20 


2 




1 


15 


66 


190 


3 






20 


220 


1,140 


4 






15 


495 


4,845 


5 






6 


792 


15,504 


6 






1 


924 


38,760 


7 








792 


77,520 



10. The following table gives the number of labeled graphs of order n having 
various properties: 



n 


1 


2 


3 


4 


5 


6 


7 


8 


All 


1 


2 


8 


64 


1024 


2 15 


2 21 


2 28 


Connected 


1 


1 


4 


38 


728 


26704 


1 866256 


251548 592 


Even 


1 


1 


2 


8 


64 


1024 


2 15 


2 21 


Trees 


1 


1 


3 


16 


125 


1296 


16 807 


262 144 



11. The following table gives the numbers of isomorphism classes of graphs of 
order n exhibiting various properties: 



n 


1 


2 


3 


4 


5 


6 


7 


8 


All 


1 


2 


4 


11 


34 


156 


1044 


12 346 


Connected 


1 


1 


2 


6 


21 


112 


853 


11 117 


Even 


1 


1 


2 


3 


7 


16 


54 


243 


Eulerian 


1 





1 


1 


4 


8 


37 


184 


Blocks 





1 


1 


3 


10 


56 


468 


7 123 


Trees 


1 


1 


1 


2 


3 


6 


11 


23 


Rooted trees 


1 


1 


2 


4 


9 


20 


48 


115 
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3.4.4.12 Descriptions of graphs with few vertices 

The small graphs can be described in terms of the operations on page 228. Let Q 
denote the family of isomorphism classes of graphs of order n and size m. Then 







Ga,g 


— iK,\ 

— X^ih 


£2,0 


= {K2}, 


Gi,i 


= {P 2 UK 2 }, 


Gl,\ 


= {K2}, 


Gi,2 


= {P 3 UK 1 ,P 2 UP 2 }, 


G 3 ,0 


= {K 3 }, 


Gi,3 


= {P 4 ,K 3 UK U K 1)3 }, 


£3,1 


= {K 2 UK 1 }, 


Gi,4 


= {C 4 ,(K 2 UK 1 )+K 1 } 


03,2 


= {Ps}, 


Gi,h 


= {K 4 - e}, 


<?3,3 


= {Ks}, 


Gifi 


= {K 4 } 



3.4.5 TREE DIAGRAMS 

Let T n m denote the m th isomorphism class of trees of order n. Figure 3.4 (page 
242) depicts trees of order at most 7. Figure 3.5 (page 243) depicts trees of order 8. 



3.5 COMBINATORIAL DESIGN THEORY 

Combinatorial design theory is the study of families of subsets with various pre- 
scribed regularity properties. An incidence structure is an ordered pair (X, £>): 

1 . X = {xi , . . . , x v } is a set of points. 

2. B = {P>i , . . . , Bt>} is a set of blocks or lines; each Bj CI. 

3. The replication number r, of X{ is the number of blocks that contain x i. 

4. The size of Bj is kj . 

Counting the number of pairs (x, B) with x £ B yields £3" =1 r« = Ylj=i ^i- The 
incidence matrix of an incidence structure is the v x b matrix A = (oy) with Oy = 1 
if xi £ Bj and otherwise. 



3.5.1 ^-DESIGNS 

The incidence structure (X, £>) is called a i-(v, k, A) design if 

1. For all j, kj = k and 1 < k < v, and 

2. Any subset of t points is contained in exactly A blocks. 
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FIGURE 3.4 

Trees with 7 or fewer vertices. 




© 2003 by CRC Press LLC 



FIGURE 3.5 

Trees with 8 vertices. 
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A 1 -design is equivalent to a v x 6 0-1 matrix with constant row and column 
sums. Every t-(v, k, A) design is also a £-(v, k, Xi) design (1 < I < t), where 

A necessary condition for the existence of a t-(v, k, A) design is that Xi must be an 
integer for all £, 1 < I < t. Another necessary condition is the generalized Fisher's 
inequality: if t = 2s, then b > (^) . 

3.5.1.1 Related designs 

The existence of a t-(v, k, A) design also implies the existence of the following de- 
signs: 

Complementary design 

Let Be = {X\B | B € £>}. Then the incidence structure (X,Bc) is a 

t-(v,v -fc,A(V) /(IZl)) design (provided v >k + t). 
Derived design 

Fix x € X and let Bd = {B\{x} \ B € B with x € B}. Then the incidence 
structure (X\{x},Bd) is a (i — l)-(v - l,k - 1, A) design. 

Residual design 

Fix a; € Xand let B fi = {5 | B e K with a; $ 5}. Then the incidence 
structure (X\{x},B R ) is a (t - l)-(« - l.fc - 1, /(^*) ) design. 

3.5.1.2 The Mathieu 5-design 

The following are the 132 blocks of a 5-(12,6,l) design. The blocks are the supports 
of the weight-6 codewords in the ternary Golay code (page 258). Similarly, the 
supports of the 759 weight-8 codewords in the binary Golay code form the blocks of 
a 5-(24,8,l) design. 
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3.5.2 BALANCED INCOMPLETE BLOCK DESIGNS (BIBDS) 

Balanced incomplete block designs (BIBDs) are i-designs with t = 2, so that every 
pair of points is on the same number of blocks. The relevant parameters are v, b, r, 
k, and A with 

vr = bk and v(v - 1)A = bk(k - 1). (3.5.2) 

If A is the v x b incidence matrix, then AA J = (r — X)I V + XJ V , where I n is the 
n x n identity matrix and J„ is the n x n matrix of all ones. 

3.5.2.1 Symmetric designs 

Fisher's inequality states that b > v. If b = v (equivalently, r = k), then the BIBD 
is called a symmetric design, denoted as a (v, k, A) -design. The incidence matrix for 
a symmetric design satis es 

J V A = kJ v = AJ V and A T A = (k - \)I V + XJ V , (3.5.3) 

that is, any two blocks intersect in A points. The dualness of symmetric designs can 
be summarized by the following: 

v points i — > v blocks, 

k blocks on a point < — > k points in a block, and 

Any two points on A blocks < — > Any two blocks share A points. 

Some necessary conditions for symmetric designs are 

1 . If v is even, then k — A is a square integer. 

2. Bruck-Ryser-Chowla theorem: If v is odd, then the following equation has 
integer solutions (not all zero): 

x 2 = (k-X)y 2 + {-l) (v -^l 2 Xz 2 . 
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3.5.2.2 Existence table for BIBDs 



Some of the most fruitful construction methods for BIBD are dealt with in sepa- 
rate sections, difference sets (page 246), nite geometry (page 247), Steiner triple 
systems (page 249), and Hadamard matrices (page 249). The table below gives all 
parameters for which BIBDs exist with k < v/2 and b < 30. 



V 


b 


r 


k 


A 


6 


10 


5 


3 


2 







1 c\ 


J 


A 

4 







1 c 
1 J 







7 


7 


3 


3 


1 


7 


14 


6 


3 


2 


7 


21 


9 


3 


3 


7 


28 


12 


3 


4 


8 


14 


7 


4 


3 


8 


28 


14 


4 


6 


9 


12 


4 


3 


1 


9 


18 


8 


4 


3 


9 


24 


8 


3 


2 


10 


15 


6 


4 


2 





b 


r 


k 
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3.5.3 DIFFERENCE SETS 

Let G be a nite group of order v (see page 161). A subset D of size k is a (v, k, A) - 
difference set in G if every non-identity element of G can be written A times as 
a "difference" did^ 1 with di and 4 in £>. If G is the cyclic group Z v , then the 
difference set is a cyclic difference set. The order of a difference set is n = k — A. 
For example, {1, 2, 4} is a (7, 3, 1) cyclic difference set of order 2. 

The existence of a (v,k, A) -difference set implies the existence of a (v, k, A)- 
design. The points are the elements of G and the blocks are the translates of D: all 
sets Dg = {dg : d € D} for g € G. Note that each translate Dg is itself a difference 
set. 

EXAMPLES 

1. Here are the 7 blocks for a (7, 3, l)-design based on D = {1, 2, 4}: 

124 235 346 450 561 602 013 

2. A (16, 6, 2)-difference set in G = Z 2 Z 2 Z 2 Z 2 is 

0000 0001 0010 0100 1000 1111 

3. A (21,5,l)-difference set in G = (a, b \ a 3 = b 7 = 1, a^ba = a 4 ) is {a, a 2 ,b, b 2 ,b 4 }. 



3.5.3.1 Some families of cyclic difference sets 

Paley: Let v be a prime congruent to 3 modulo 4. Then the non-zero squares in Z v 
forma (w,(w-l)/2,(w-3)/4)-difference set. Example: (v,k,\) = (11,5,2). 
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Stanton-Sprott: Let v = p(p + 2), where p and p + 2 are both primes. Then there 
is&(v,(v- 1) /2, (v - 3) /4) -difference set. Example: (v, k, A) = (35, 17, 8). 



Biquadratic residues (I): If v = Aa 2 + 1 is a prime with a odd, then the non- 
zero fourth powers modulo v form a (v, (v — l)/4, (v — 5)/16)-difference set. 
Example: (v,k,X) = (37,9,2). 

Biquadratic residues (II): If v = 4a 2 + 9 is a prime with a odd, then zero and 
the fourth powers modulo v form a (v, (v + 3)/4, (v + 3)/ 16) -difference set. 
Example: (v,k,\) = (13,4,1). 

/ m _ 1 m-1 _ 1 g m-2 _ j\ 

Singer: If q is a prime power, then there exists a , , ■ 

V 9-1 9-1 9-1 / 

difference set for all m > 3. 



3.5.3.2 Existence table of cyclic difference sets 

This table gives all cyclic difference sets for k < v/2 and v < 50 up to equivalence 
by translation and multiplication by a number relatively prime to v. 
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42 



3.5.4 FINITE GEOMETRY 
3.5.4.1 Af ne planes 

A nite af ne plane is a nite set of points together with subsets of points called 
lines that satisfy the axioms: 

1 . Any two points are on exactly one line. 
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2. (Parallel postulate) Given a point P and a line L not containing P, there is 
exactly one line through P that does not intersect L. 

3. There are four points, no three of which are collinear. 

These axioms are suf cien t to show that a nite af ne plane is a BIBD (see page 
245) with 

v = n 2 b = n 2 + n r = n + 1 k = n A = l 

(n is the order of the plane). The lines of a projective plane can be divided into n + 1 
parallel classes each containing n lines. A suf cient condition for af ne planes to 
exist is for n to be a prime power. 

Below are two views of the af ne plane of order 2 showing the parallel classes. 




Below is the af ne plane of order 3 showing the parallel classes. 




3.5.4.2 Projective planes 

A nite projective plane is a nite set of points together with subsets of points called 
lines that satisfy the axioms: 

1. Any two points are on exactly one line. 

2. Any two lines intersect in exactly one point. 

3. There are four points, no three of which are collinear. 

These axioms are suf cient to show that a nite projective plane is a symmetric 
design (see page 245) with 

v = n 2 +n + l k = n + l A = 1 (3.5.4) 

(n is the order of the plane). A suf cien t condition for projective planes to exist is 
for n to be a prime power. 
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A projective plane of order n can be constructed from 
an af ne plane of order n by adding a line at in n ity. 
A line of n + 1 new points is added to the af ne plane. 
For each parallel class, one distinct new point is added 
to each line. The construction works in reverse: re- 
moving any one line from a projective plane of order n 
and its points leaves an af ne plane of order n. To the 
right is the projective plane of order 2. The center cir- 
cle functions as a line at in nity; removing it produces 
the af ne plane of order 2. 



3.5.5 STEINER TRIPLE SYSTEMS 

A Steiner triple system (STS) is a 2-(w,3,l) design. In particular, STSs are BIBDs 
(see page 245). STSs exist if, and only if, v = 1 or 3 (mod 6). The number of 
blocks in an STS is b = v(v — 1) /6. 




3.5.5.1 Some families of Steiner triple systems 

v = 2 m — 1: Take as points all non-zero vectors over Z2 of length to. A block 
consists of any set of three distinct vectors {x, y, z} such that x + y + z = 0. 

v = 3 m : Take as points all vectors over Z3 of length to. A block consists of any set 
of three distinct vectors {x, y, z} such that x + y + z = 0. 



3.5.5.2 Resolvable Steiner triple systems 

An STS is resolvable if the blocks can be divided into parallel classes such that each 
point occurs in exactly one block per class. A resolvable STS exists if and only if 
v = 3 (mod 6). For example, the af ne plane of order 3 is a resolvable STS with 
v = 9 (see page 247). 

A resolvable STS with v = 15 (b = 35) is known as the Kirkman schoolgirl 
problem and dates from 1850. Here is an example. Each column of 5 triples is a 
parallel class: 

abi acj adk ael afm agn aho 
cdf deg efh fgb ghc hbd bee 
gjo hki blj cmk dnl eom fin 
ekn flo gmi hnj bok cil djm 
him bmn cno doi eij fjk gkl 



3.5.6 HADAMARD MATRICES 

A Hadamard matrix of order n is an n x n matrix H with entries ±1 such that 
HH T = nl n . In order for a Hadamard matrix to exist, n must be 1, 2, or a mul- 
tiple of 4. It is conjectured that this condition is also suf cient. If H\ and H-2 are 
Hadamard matrices, then so is the Kronecker product H 1 (g) H%. 
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3.5.6.1 Some Hadamard matrices 

We use "— " to denote —1. 
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3.5.6.2 Designs and Hadamard matrices 

Without loss of generality, a Hadamard matrix can be assumed to have a rst row 
and column consisting of all + Is. 

BIBDs: Delete the rst row and column. The points of the design are the remaining 
column indices. Each row produces a block of the design, namely those indices 
where the entry is +1. The resulting design is an (n — 1, (n — 2) /2, (n — 4)/4) 
symmetric design (see page 249). 

3-Designs: The points are the indices of the columns. Each row, except the rst 
row, yields two blocks, one block for those indices where the entries are +1 
and one block for those indices where the entries are —1. The resulting design 
is a 3-(n,n/2, (n — 2)/2) design. 
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3.5.7 LATIN SQUARES 

A Latin square of size n is an n x n array S = [sy] of n symbols such that every 
symbol appears exactly once in each row and column. Two Latin squares S and T 
are orthogonal if every pair of symbols occurs exactly once as a pair (s y , tij). Let 
M(n) be the maximum size of a set of mutually orthogonal Latin squares (MOLS). 

1. M(n) < n - 1. 

2. M(n) = n — 1 if n is a prime power. 

3. M(mn 2 ) > min(M(ni),M(n 2 )). 

4. M(6) = 1 (i.e., there are no two MOLS of size 6). 

5. M(n) > 2 for all n > 3 except n = 6. (Latin squares of all sizes exist.) 

The existence of n — 1 MOLS of size n is equivalent to the existence of an af ne 
plane of order n (see page 247). 



3.5.7.1 Examples of mutually orthogonal Latin squares 

These are complete sets of MOLS for n = 3, 4, and 5. 
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These are two superimposed MOLS for n = 7, 8, 9, and 10. 

n = 7 n 
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3.5.8 ROOM SQUARES 



A Room square of side n is an n x n array with entries either empty or consisting of 
an unordered pair of symbols from a symbol set of size n + 1 with the requirements: 

1. Each symbol appears exactly once in each row and column. 

2. Every unordered pair occurs exactly once in the array. 

Room squares exist if and only if n is odd and n > 7. 

A Room square yields a construction of a round-robin tournament between n + 1 
opponents over n rounds and played at n locales: 

1 . Rows of the square represent rounds in the tournament. 

2. Columns in the square represent locales. 

3. Each pair represents one competition. 

Then each team plays exactly once in each round, at each locale, and against each 
opponent. 

EXAMPLE This is a Room square of side 7: 
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3.5.9 COSTAS ARRAYS 

Annxn Costas array is an array of zeros and ones whose two-dimensional autocor- 
relation function is n at the origin and no more than 1 anywhere else. There are B n 
basic Costas arrays; there are C n arrays when rotations and ips are allowed. Each 
array can be interpreted as a permutation. 
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3.6 COMMUNICATION THEORY 



3.6.1 INFORMATION THEORY 
3.6.1.1 De nitions 

xi j Px2 j ■ ■ ■ j Px„ ) be the probability distribution of the discrete random 
variable X with Prob (X = Xj) = p Xi . The entropy of the distribution is 

H (Px) = ~^2Pxi1og 2 p Xi . (3.6.1) 

Xi 

The units for entropy are bits. Entropy measures how much information is gained 
from learning the value of X. When X takes only two values, p = (p, 1 — p), then 

H(p x ) = H(p, l-p) = -p\og 2 p- (1 - p) log 2 (l - p). (3.6.2) 

This is also denoted H(p). The range of H(p) is from to 1 with a maximum at 
p = 0.5. Below is a plot of p versus H(p). The maximum of H (p x ) * s 1°S2 71 an ^ is 
obtained when X is uniformly distributed, taking n values. 

1 

0.8 
0.6 
0.4 
0.2 



0.2 0.4 0.6 0.8 1 
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Given two discrete random variables X and Y, p Xxy is the joint distribution of 
X and Y. The mutual information of X and Y is de ned by 

I(X, Y) = H(p x ) + H(p y ) - #(p Xxy ). (3.6.3) 

Note that (a) /(X,y) = /(K.X); (b) I(X, Y) > 0; and (c) I(X, Y) = if, and only 
if, X and Y are independent. Mutual information gives the amount of information 
that learning a value of X says about the value of Y (and vice versa). 

3.6.1 .2 Continuous entropy 

For a d-dimensional continuous random variable X, the entropy is 

h(X) = - I p(x)\ogp(x)dx. (3.6.4) 

m d 

Continuous entropy is not the limiting case of the entropy of a discrete random 
variable. In fact, if X is the limit of the one-dimensional discrete random variable 
{X„}, and the entropy of X is nite, then 

lim (H(X n ) - n log 2) = h{X). (3.6.5) 

n— f oo 

If X and Y are continuous d-dimensional random variables with density func- 
tions p(x) and q(y), then the relative entropy is 

H(X, Y) = / p(x) log 44 dx - ( 3 - 6 - 6 ) 

A d-dimensional normal (or Gaussian) random variable AT (a, T) has the density 
function 

<?(x) = 1 ; exp ( -^(x-a^r-^x-a) ] (3.6.7) 

where a is the vector of means and T is the positive de nite covariance matrix. 

1 . If X = (Xi , Xi , . . . , Xd) is a d-dimensional normal random vector with dis- 
tribution AT (a, T) then h(X) = \ log ^(27re) d |r|j . 

2. If X and Y are d-dimensional normal random vectors with distributions A* (a, T) 
and N(b, A) then 

H(X, Y) = \ (log J|| + tr (r (A" 1 - T- 1 ) ) + (a - bfA" 1 (a - b)) 

(3.6.8) 

3. If X is a d-dimensional normal random vector with distribution AT (a, T), and if 
Y is a d-dimensional random vector with a continuous probability distribution 
having the same covariance matrix T, then h(X) < h(Y). 
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3.6.1.3 Channel capacity 

The transition probabilities are de ned by t XyV = Prob (Y = y | X = x). The distri- 
bution p x determines p Y by P y = t x , v Px ■ The matrix T = (t X:V ) is the transition 
matrix. The matrix T de ne s a channel given by a transition diagram (input is X, 
output is Y). For example (here X and Y only take two values), 




%i,yi 



The capacity of the channel is de ned as 

C = max/(X,Y). (3.6.9) 

A channel is symmetric if each row is a permutation of the rst row and each 
column is a permutation of the rst column. The capacity of a symmetric channel 
is C = log 2 n — H(p), where p is the rst row; the capacity is achieved when p x 
represents equally likely inputs. The channel shown on the left is symmetric; both 
channels achieve capacity with equally likely inputs. 



Binary symmetric channel Binary erasure channel 




1 — p 1 — p 

C = l-H(p) C = l-p 

3.6.1.4 Shannon's theorem 

Let both X and Y be discrete random variables with values in an alphabet A. A code 
is a set of codewords (n-tuples with entries from A) that is in one-to-one correspon- 
dence with a set of M messages. The rate R of the code is de ned as i log 2 M. 
Assume that the codeword is sent via a channel with transition matrix T by sending 
each vector element independently. De ne 

e= max Prob ((codeword incorrectly decoded)). (3.6.10) 

all codewords 

Shannon's coding theorem states: 

1 . If R < C, then there is a sequence of codes with rate R and n4co such that 
e -> 0. 

2. If R > C, then e is always bounded away from 0. 
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3.6.2 BLOCK CODING 



3.6.2.1 De nitions 

A code C over an alphabet A is a set of vectors of a x ed length n with entries from 
A, Let A be the nite eld GF(g) (see Section 2.7.6.1). If C is a vector space over 
A, then C is a linear code; the dimension A; of a linear code is its dimension as a 
vector space. The Hamming distance dn{a.,y) between two vectors, u and v, is the 
number of places in which they differ. For a vector u over GF(g), de ne the weight, 
wt(u), as the number of non-zero components. Then de(u,v) = wt(u — v). The 
minimum Hamming distance between two distinct vectors in a code C is called the 
minimum distance d. A code can detect e errors if e < d. A code can correct t errors 
if 2t + 1 < d. 

3.6.2.2 Coding diagram for linear codes 



Encoding Channel Decoding 



x message 




xG codeword 




y received word 




yH syndrome 









1 . A message x consists of k information symbols. 

2. The message is encoded as xG £ C, where G is a k x n matrix called the 
generating matrix. 

3. After transmission over a channel, a (possibly corrupted) vector y is received. 

4. There exists a parity check matrix H such that c 6 C if and only if cH = 0. 
Thus the syndrome z = yH can be used to try to decode y. 



5. If G has the form [I A], where / is the k x k identity matrix, then H = 




Note: in coding theory unspeci ed vectors are usually row vectors. 

3.6.2.3 Cyclic codes 

A linear code C of length n is cyclic if (so, • ■ ■ , a n -i) G C implies (a„_i, oq, . . . , 
£ C. To each codeword (00, ai, ■ ■ • , a n -i) 6 C is associated the polynomial 
a ( x ) = Sfco a « a; *- Every cyclic code has a generating polynomial g(x) such that 
a(x) corresponds to a codeword if, and only if, a(x) = d(x)g(x) (mod x n — 1) 
for some d(x). The roots of a cyclic code are roots of g(x) in some extension eld 
GF(g') with primitive element a. 

1. BCH Bound: If a cyclic code C has roots a', , . . . , a t+d ~ 2 , then the min- 
imum distance of C is at least d. 
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2. Binary BCH codes (BCH stands for Bose, Ray-Chaudhuri, and Hocquenghem): 
Fix m, dene n = 2 m — 1, and let a be a primitive element in GF(2 m ). Dene 
fi{x) as the minimum binary polynomial of a*. Then 



de ne s a generating polynomial for a binary BCH code of length n and mini- 
mum distance at least S = 2e + 1 (5 is called the designed distance). The code 
dimension is at least n — me. 

3. Dual code: Given a code C, the dual code is C 1 - = {a | a • x = for all 
x £ C}. The code C 1 - is an (n, n — k) linear code over the same eld. A code 
is self-dual if C = C 1 - . 

4. MDS codes: A linear code that meets the Singleton bound, n + 1 = k + d, is 
called MDS (for maximum distance separable). Any k columns of a generating 
matrix of an MDS code are linearly independent. 

5. Reed-Solomon codes: Let a be a primitive element for GF(g) and n = q — 1. 
The generating polynomial g(x) = (x — a)(x — a 2 ) ■ ■ ■ (x — de nes a 
cyclic MDS code with distance d and dimension k = n — d + 1. 

6. Hexacode: The hexacode is a (6,3,4) self-dual MDS code over GF(4). Let 
the nite eld of four elements be {0, 1, a, b} with b = a 2 = a + 1. The code is 
generated by the vectors (1, 0, 0, 1, b, a), (0, 1, 0, 1, a, b), and (0, 0, 1, 1, 1, 1). 
The 64 codewords are: 

000000 lOOlba aOOalb bOObal OlOlab 110011 alObbO blOaOa 

OaOabl laObOb aaOOaa baOHO ObObla lbOaaO abOlOl bbOObb 

001111 lOlOab aOlbOa bOlabO OllOba 111100 allaal bllblb 

OalbaO lalala aallbb balOOl OblaOb lblbbl ablOlO bbllaa 

OOaaaa lOablO aOaObl bOalOb OlabOl llaabb alalia blaOaO 

OaaOlb laalal aaaaOO baabba ObalbO IbaOOa ababab bbaall 

OObbbb lObaOl aOblaO bObOla OlbalO llbbaa albOOb blblbl 

OablOa labObO aabbll babaab ObbOal lbbllb abbaba bbbbOO. 

7. Perfect codes: A linear code is perfect if it satis es the Hamming bound, 
q n ~ k = — !)*• The binary Hamming codes and Golay codes 
are perfect. 

8. Binary Hamming codes: These codes have parameters {n = 2 m — 1, k = 
2 m — 1— m,d = 3}. The parity check matrix is the 2 m — 1 x m matrix whose 
rows are all of the binary m-tuples in a x ed order. The generating and parity 
check matrices for the (7, 4) Hamming code are 



g(x) = LCM(f 1 (x),...,f 2e (x)) 



(3.6.11) 



G=[I A] 



'1 1 1 0' 

10 10 1 

1 1 1 

1 1 1 1 



H = 



-A 
I 



T 1 0" 

1 1 

1 1 

111 

1 
1 
1 



(3.6.12) 
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9. Binary Golay code: This has the parameters {n = 24, k = 12, d = 8}. The 
generating matrix is 



G=[I A] 



100000000000 
10000000000 
00 1000000000 
000 100000000 
0000 10000000 
00000 1000000 
000000 100000 
0000000 10000 
00000000 1000 
000000000 100 
0000000000 10 
00000000000 1 



11111111111" 
111011100010 
110111000101 
101110001011 
111100010110 
111000101101 
110001011011 
100010110111 
100101101110 
101011011100 
110110111000 
101101110001 



(3.6.13) 



10. Ternary Golay code: This has the parameters {n 
generating matrix is 



12, fe = 6,d = 6}. The 



G=[I A] 



100000 
10000 
00 1000 
000 100 
0000 10 
00000 1 



11111' 
10 1221 
110 122 
12 10 12 
122101 
112210 



(3.6.14) 



3.6.2.4 Bounds 

Bounds for block codes investigate the trade-offs between the length n, the number 
of codewords M, the minimum distance d, and the alphabet size q. The number of 
errors that can be corrected is e with 2e + 1 < d. If the code is linear, then the bounds 
concern the dimension k with M = q k . 

1. Hamming or sphere-packing bound: M < q n j Yli=o (1) (l ~ 1)' ■ 

2. Plotkin bound: Suppose that d > n(q - 1) jq. Then M < qd _^ q _^ ■ 

3. Singleton bound: For any code, M < q n ~ d+1 ; if the code is linear, then 
k + d<n + l. 

4. Varsharmov-Gilbert bound: There is a block code with minimum distance at 
least d and M > q n j Zto (") (« " !)'■ 
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3.6.2.5 Table of binary BCH codes 



n 


k 


d 




n 


k 


<i 




n 


fc 


d 


7 


4 


3 




63 


45 


7 




127 


92 


11 












39 


9 






85 


13 


15 


11 


3 






36 


11 






78 


15 




7 


5 






30 


13 






71 


19 




5 


7 






24 


15 






64 


21 












18 


21 






57 


23 


31 


26 


3 






16 


23 






50 


27 




21 


5 






10 


27 






43 


31 




16 


/ 






/ 


*3 1 

31 






36 


1 1 
31 




11 


11 














29 


> 43 




6 


15 




127 


120 


3 






22 


47 












113 


5 






15 


55 


63 


57 


3 






106 


7 






8 


63 




51 


5 






99 


9 











3.6.2.6 Table of best binary codes 

Let A(n,d) be the number of codewords 1 in the largest binary code of length n 
and minimum distance d. Note that A(n — l,d — 1) = A(n, d) if d is odd and 
A(n, 2) = 2™ _1 (given, e.g., by even weight words). 



n 


d = 4 


d = 6 


d= 8 


d = 10 


6 


4 


2 


1 


1 


7 


8 


2 


1 


1 


8 


16 


2 


2 


1 


9 


20 


4 


2 


1 


10 


40 


6 


2 


2 


11 


72 


12 


2 


2 


12 


144 


24 


4 


2 


13 


256 


32 


4 


2 


14 


512 


64 


8 


2 


15 


1024 


128 


16 


4 


16 


2048 


256 


32 


4 


17 


2720-3276 


256-340 


36-37 


6 


18 


5312-6552 


512-680 


64-74 


10 


19 


10496-13104 


1024-1288 


128-144 


20 


20 


20480-26208 


2048-2372 


256-279 


40 


21 


36864-43690 


2560-4096 


512 


42-48 


22 


73728-87380 


4096-6942 


1024 


50-88 


23 


147456-173784 


8192-13774 


2048 


76-150 


24 


294912-344636 


16384-24106 


4096 


128-280 



'Data from Sphere Packing, Lattices and Groups by J. H. Conway and N. J. A. Sloane, 3rd ed., 
Springer- Verlag, New York, 1998. 
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3.6.3 SOURCE CODING FOR ENGLISH TEXT 

English text has, on average, 4.08 bits/character. 



Letter 


Probability 


Huffman code 


Alphabetical code 


Space 


0.1859 


000 


00 


A 


0.0642 


0100 


0100 


B 


0.0127 


011111 


010100 


C 


0.0218 


11111 


010101 


D 


0.0317 


01011 


01011 


E 


0.1031 


101 


0110 


F 


0.0208 


001100 


011100 


G 


0.0152 


011101 


011101 


H 


0.0467 


1110 


01111 


I 


0.0575 


1000 


1000 


J 


0.0008 


0111001110 


1001000 


K 


0.0049 


01110010 


1001001 


L 


0.0321 


01010 


100101 


M 


0.0198 


001101 


10011 


N 


0.0574 


1001 


1010 





0.0632 


0110 


1011 


P 


0.0152 


011110 


110000 


Q 


0.0008 


0111001101 


110001 


R 


0.0484 


1101 


11001 


S 


0.0514 


0010 


1101 


T 


0.0796 


0010 


1110 


U 


0.0228 


11110 


111100 


V 


0.0083 


0111000 


111101 


w 


0.0175 


001110 


111110 


X 


0.0013 


0111001100 


1111110 


Y 


0.0164 


001111 


11111110 


Z 


0.0005 


0111001111 


11111111 


Cost 


4.0799 


4.1195 


4.1978 



3.6.4 MORSE CODE 

The international version of Morse code is 



A 


• — 




K 


— • — 




U 


• • — 




1 




B 


— • • • 




L 


• — • • 




V 


• • • — 




2 


• • 


C 


— • — • 




M 






w 


• 




3 


• • • 


D 


— • • 




N 


— • 




X 


— • • — 




4 


• • • • — 


E 


• 




O 






Y 


— • 




5 




F 


• • — • 




P 


• • 




Z 


• • 




6 


— • • • • 


G 


• 




Q 


• — 










7 


• • • 


H 


• • • • 




R 


• — • 




Period 


• — • — • — 




8 


• • 


I 


• • 




S 


• • • 




Comma 


• • 




9 




J 


• 




T 






Question 


• • • • 
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3.6.5 GRAY CODE 

A Gray code is a sequence ordering such that a small change in the sequence number 
results in a small change in the sequence. 

EXAMPLES 

1. The sixteen 4-bit strings {0000, 0001, . . . , 1111} can be ordered so that adjacent bit 
strings differ in only 1 bit: 



Sequence number 


Bit string 




Sequence number 


Bit string 





0000 




8 


1100 


1 


0001 




9 


1101 


2 


0011 




10 


1111 


3 


0010 




11 


1110 


4 


0110 




12 


1010 


5 


0111 




13 


1011 


6 


0101 




14 


1001 


7 


0100 




15 


1000 



2. The subsets of {a, b, c] can be ordered so that adjacent subsets differ by only the inser- 
tion or deletion of a single element: 

<j>, {a}, {a,b}, {b}, {b,c}, {a,6,c}, {a,c}, {c}. 



3.6.6 FINITE FIELDS 

Pertinent de nitio ns for nite elds may be found in Section 2.7.6 on page 169. 

3.6.6.1 Irreducible polynomials 

Let N q (n) be the number of monk irreducible polynomials of degree n over GF(g). 
Then 

q n = Y^dN q (d) and N q (n) = (3.6.15) 

d\n d\n 

where //(•) is the number theoretic Mobius function (see page 102). 

3.6.6.2 Table of binary irreducible polynomials 

The table lists the non-zero coef cien ts of binary irreducible polynomials, e.g., 2 10 
corresponds tox 2 +X 1 +x° = x 2 +x+l. The exponent of an irreducible polynomial 
is the smallest L such that f(x) divides x L — 1. A "P" after the exponent indicates 
that the polynomial is primitive. 
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fix) 


Exponent 


fix) 


Exponent 


fix) 


Exponent 


2 1 


3P 


7 3 2 1 


127 P 


86432 10 


255 P 


3 1 


7P 


740 


127 P 


865 1 


255 P 


320 


7P 


74320 


127 P 


865 20 


255 P 


4 1 


15 P 


752 1 


127 P 


865 3 


255 P 


420 


15 P 


75 3 1 


127 P 


86540 


255 P 


432 1 


5 


75430 


127 P 


86542 10 


85 


520 


31 P 


75432 1 


127 P 


86543 10 


85 


5 3 


31 P 


760 


127 P 


87 2 1 


255 P 


5 3 2 1 


31 P 


76 3 1 


127 P 


87 3 1 


85 


542 1 


31 P 


764 1 


127 P 


87 3 20 


255 P 


543 1 


31 P 


76420 


127 P 


87432 10 


51 


543 20 


31 P 


76520 


127 P 


87 5 1 


85 


6 1 


63 P 


7653210 


127 P 


87 5 3 


255 P 


6 3 


9 


76540 


127 P 


87 5 40 


51 


642 1 


21 


76542 10 


127 P 


8754320 


85 


643 1 


63 P 


7654320 


127 P 


87 6 1 


255 P 


650 


63 P 


84 3 1 


51 


87632 10 


255 P 


652 1 


63 P 


84 3 20 


255 P 


87642 1 


17 


65 3 20 


63 P 


8 5 3 1 


255 P 


8764320 


85 


654 1 


63 


8 5 3 20 


255 P 


87652 10 


255 P 


65420 


21 P 


8 543 


17 


87654 10 


51 


7 1 


127 P 


85432 10 


85 


8765420 


255 P 


730 


127 P 


8 6 3 20 


255 P 


8765430 


85 



3.6.6.3 Table of binary primitive polynomials 

Listed below 2 are primitive polynomials, with the least number of non-zero terms, 
of degree from 1 to 64. Only the exponents of the non-zero terms are listed, e.g., 2 1 
corresponds to a; 2 + x + 1. 



fix) 




fix) 




fix) 




fix) 




fix) 


1 




145 3 1 




27 5 2 1 




40 5 4 3 




53 62 1 


2 1 




15 1 




28 3 




41 3 




54 6 5 4 3 2 


3 1 




165 3 20 




29 2 




42 5 4 3 2 1 




55 62 1 


4 1 




17 3 




30 6 4 1 




43 6 4 3 




56 7 420 


520 




18 5 2 1 




31 30 




44 6 5 2 




57 5 3 20 


6 1 




195 2 1 




3275 3 2 1 




45 4 3 1 




58 65 1 


7 1 




20 3 




33 64 1 




46 8 5 3 2 1 




5965 43 1 


843 20 




21 2 




34 7 6 5 2 1 




47 5 




60 1 


940 




22 1 




35 2 




48 7 5 4 2 1 




61 5 2 1 


10 3 




23 5 




366542 1 




49 6 5 4 




62 6 5 3 


1120 




24 4 3 1 




37 5 4 3 2 1 




50 4 3 2 




63 1 


12 64 1 




25 3 




38 65 1 




51 63 10 




64 4 3 1 


1343 1 




26 6 2 1 




39 4 




52 3 





2 Taken in part from "Primitive Polynomials (Mod 2)", E. J. Watson, Math. Comp., 16, 368-369, 1962. 
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3.6.7 BINARY SEQUENCES 



3.6.7.1 Barker sequences 

A Barker sequence is a sequence (s\,S2, ■ ■ ■ ,sn) with sj = ±1 such that 
^2j=i s j s j+i = ±1 or 0, for i = 1, . . . , N — 1. The following table lists all known 
Barker sequences (up to reversal, multiplication by —1, and multiplying alternate 
values by — 1). 



Length 


Barker sequence 


2 


+1 


+1 










3 


+1 


+1 


-1 








4 


+1 


+1 


+1 


-1 






4 


+1 


+1 


-1 


+1 






5 


+1 


+1 


+1 


-1 


+1 




7 


+1 


+1 


+1 


-1 


-1 


+1 -1 


11 


+1 


+1 


+1 


-1 


-1 


-1 +1 -1 -1 +1 -1 


13 


+1 


+1 


+1 


+1 


+1 


-1 -1 +1 +1 -1 +1 -1 +1 



3.6.7.2 Periodic sequences 

Let s = (so, si, . . . , sjv-i) be a periodic sequence with period N. A (left) shift 
of s is the sequence (si , . . . , sjv-i , so) ■ F° r r relatively prime to N, the decima- 
tion of s is the sequence (s , s T , S2 T , ■ ■ ■ )> which also has period N. The periodic 
autocorrelation is de ned as the vector (a , ■ ■ ■ , ajv-i), with 

JV-l 

a, = ^2 s j s j+ii (subscripts taken modulo AO. (3.6.16) 

3=0 

An autocorrelation is two-valued if all values are equal except possibly for the th 
term. 



3.6.7.3 The m-sequences 

A binary m-sequence of length N = 2 r — 1 is the sequence of period N de ne d by 

(s ,si,...,sjv-i), Si=Tr(a z ), (3.6.17) 

where a is a primitive element of GF(2 r ) and Tr is the trace function from GF(2 r ) 
to GF(2) de ned by Tr(/3) = R + /3 2 + /3 4 + ■ ■ ■ + /3 2 "' 1 . 

1 . All m-sequences of a given length are equivalent under decimation. 

2. Binary m-sequences have a two-valued autocorrelation (with the identi cation 
thatO -H- +1 and 1 -H- -1). 

3. All m-sequences possess the span property: all binary r-tuples occur in the 
sequence except the all-zeros r-tuple. 

The existence of a binary sequence of length 2 " — 1 with a two-valued autocor- 
relation is equivalent to the existence of a cyclic difference set with parameters 
(2 n - 1,2"-! - l,2 n " 2 - 1). 
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3.6.7.4 Shift registers 

Below are examples of the two types of shift registers used to generate binary re- 
sequences. The generating polynomial in each case is x 4 + x + 1, the initial register 
loading is 1 0, and the generated sequence is {0, 0, 0, 1, 0, 0, 1, 1, 0, 1, 0, 1, 1, 1, 
1,...}. 



Additive shift register 



Multiplicative shift register 



















3.6.7.5 Binary sequences with two-valued autocorrelation 

The following table lists all binary sequences with two-valued periodic autocorrela- 
tion of length 2™ — 1 for n = 3 to 8 (up to shifts, decimations, and complementation). 
The table indicates the positions of 0; the remaining values are 1. An S indicates that 
that sequence has the span property. 



n 


Positions of 


'i S 


1 2 4 


4S 


1 245 8 10 


5S 


1 2 3 4 6 8 12 15 16 17 23 24 27 29 30 


5 


1 245 7 8 9 10 14 16 18 19 2025 28 


6S 


1 23467 8 9 12 13 14 16 18 19 24 26 27 28 32 33 35 36 38 41 45 48 49 52 54 56 


6 


1 2 3 4 5 6 8 9 10 12 16 17 18 20 23 24 27 29 32 33 34 36 40 43 45 46 48 53 54 58 


7 


1 24 8 9 11 13 15 16 17 18 19 21 22 25 26 30 31 32 34 35 36 37 38 41 42 44 47 49 50 52 60 61 62 64 68 
69 70 71 72 73 74 76 79 81 82 84 87 88 94 98 99 100 103 104 107 113 115 117 120 121 122 124 


7 


1 2 3 4 5 6 7 8 10 12 14 16 19 20 23 24 25 27 28 32 33 38 40 46 47 48 50 51 54 56 57 61 63 64 65 66 67 
73 75 76 77 80 87 89 92 94 95 96 97 100 101 102 107 108 111 112 114 117 119 122 123 125 126 


7S 


1 2 3 4 6 7 8 9 12 14 15 16 17 18 24 27 28 29 30 31 32 34 36 39 47 48 51 54 56 58 60 61 62 64 65 67 68 
71 72 77 78 79 83 87 89 94 96 97 99 102 103 105 107 108 112 113 115 116 117 120 121 122 124 


7 


1 2 3 4 6 7 8 9 12 13 14 16 17 18 19 24 25 26 27 28 31 32 34 35 36 38 47 48 50 51 52 54 56 61 62 64 65 
67 68 70 72 73 76 77 79 81 87 89 94 96 97 100 102 103 104 107 108 112 115 117 121 122 124 


7 


1 2 3 4 5 6 8 9 10 12 15 16 17 18 19 20 24 25 27 29 30 32 33 34 36 38 39 40 48 50 51 54 55 58 59 60 64 
65 66 68 71 72 73 76 77 78 80 83 89 91 93 96 99 100 102 105 108 109 110 113 116 118 120 


7 


1 23 45 6 8 10 11 12 16 1920 21 22 2425 27 29 32 33 37 38 39 40 41 42 44 48 49 50 51 54 58 63 64 65 
66 69 73 74 76 77 78 80 82 83 84 88 89 95 96 98 100 102 105 108 1 1 1 1 16 1 19 123 125 126 


8S 


1 2 3 4 6 7 8 12 13 14 16 17 19 23 24 25 26 27 28 31 32 34 35 37 38 41 45 46 48 49 50 51 52 54 56 59 
62 64 67 68 70 73 74 75 76 82 85 90 92 96 98 99 100 102 103 104 105 108 111 112 113 118 119 123 124 
127 128 129 131 134 136 137 139 140 141 143 145 146 148 150 152 153 157 161 164 165 170 177 179 
180 183 184 187 189 191 192 193 196 197 198 199 200 204 206 208 210 216 217 219 221 222 223 224 
226 227 236 237 238 239 241 246 247 248 251 253 254 


8 


1 247 8 9 11 14 16 17 18 19 21 22 23 25 27 28 29 32 33 34 35 36 38 42 43 44 46 49 50 51 54 56 58 61 
64 66 68 69 70 71 72 76 79 81 84 85 86 87 88 89 92 93 95 97 98 99 100 101 102 108 112 113 1 16 1 17 1 19 
122 125 128 131 132 133 136 137 138 139 140 141 142 144 145 149 152 153 158 162 163 167 168 170 
171 172 174 175 176 177 178 184 186 187 190 193 194 196 197 198 200 202 204 209 211 213 215 216 
221 224 226 232 233 234 235 238 244 245 250 


8 


1 2 3 4 6 8 12 13 15 16 17 24 25 26 27 29 30 31 32 34 35 39 47 48 50 51 52 54 57 58 59 60 61 62 64 67 
68 70 71 78 79 85 91 94 96 99 100 102 103 104 107 108 109 114 116 118 119 120 121 122 124 127 128 
129 134 135 136 140 141 142 143 145 147 151 153 156 157 158 161 163 167 170 173 177 179 181 182 
187 188 191 192 195 198 199 200 201 203 204 206 208 209 211 214 216 217 218 221 223 225 227 228 
229 232 233 236 238 239 240 241 242 244 247 248 251 253 254 


8 


1 2 3467 8 11 12 14 15 16 1721 2223 2425 28 29 30 32 34 35 37 41 42 44 46 47 48 50 51 56 58 60 64 
68 69 70 71 73 74 81 82 84 85 88 91 92 94 96 97 100 102 107 109 111 112 113 116 119 120 121 123 127 
128 129 131 133 135 136 138 139 140 142 145 146 148 151 153 162 163 164 168 170 173 176 181 182 
183 184 187 188 189 191 192 193 194 195 197 200 203 204 209 214 218 219 221 222 223 224 225 226 
229 232 237 238 239 240 242 246 247 251 253 254 
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3.7 DIFFERENCE EQUATIONS 



3.7.1 THE CALCULUS OF FINITE DIFFERENCES 

1. A(f(x)) = f(x + h) — f(x) (forward difference). 

2. A 2 (/(a;)) = f(x + 2h) - 2f(x + h) + f(x). 

3. A n (f(x)) = A (A n_1 (/(a;))) = £(-1)* fyf(x + (n - k)h). 

4. A{cf{x)) = cA{f{x)). 

5. A(f(x)+g(x)) = A(f(x)) + A(g(x)). 

6. A(f(x)g(x))=g(x)A(f(x))+f(x)A(g(x)). 

* I f(r)\ ( ]{x)A(f(x)) — f(x)A(q(x)) . , , , , x , , x , n 
? - A (f}) = 9 (x) 9 (x + h) [g[ >V™^ that g { x)g { x + h )*0. 

8. A n (x n ) =nlh n , n = 0,l,.... 



3.7.2 EXISTENCE AND UNIQUENESS 

A difference equation of order k has the form 

x n +k = f(x n ,x n +i,- ■ ■ ,x n+ ( k -i),n) (3.7.1) 

where/ is a given function and k is a positive integer. A solution to Equation (3.7. 1) is 
a sequence of numbers {x n }^ which satis es the equation. Any constant solution 
of Equation (3.7. 1) is called an equilibrium solution. 
A linear difference equation of order k has the form 

(k) . (k-1) . (1) . (0) /Q r-l ~, 

a; n >x n+k +a; n ' x n+ ( k _i) H h a K „ 'x n -i + a> n >x n = g n , (3.7.2) 

where k is a positive integer and the coef cients a„\ along with {<?„} are 

known. If the sequence g n is identically zero, then Equation (3.7.2) is called homo- 
geneous; otherwise, it is called non-homogeneous. If the coef cients a n \ • . • , o!n ^ 
are constants (i.e., do not depend on n), Equation (3.7.2) is a difference equation with 
constant coef cients; otherwise it is a difference equation with variable coef cients. 



THEOREM 3.7.1 (Existence and uniqueness) 
Consider the initial-value problem (IVP) 

, h (k-\) j.j.M — / 

Xn+k i On 2 ; n+(S;— 1) ' ' ' ' ' "n %n+l < "n X n — J n , ^ ^ 

xi=a u i = 0,1, . . . ,k - 1, 

for n = 0,1,..., where b^n and /„ are given sequences with bn^ ^ 0/or all n and 
the {a{\ are given initial conditions. Then the above equations have exactly one 
solution. 
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3.7.3 LINEAR INDEPENDENCE: GENERAL SOLUTION 

The sequences x^ 2 \ x^ (sequence x^ has the terms {x^\x^\x2^ ,•••}) 
are linearly dependent if constants c\,ci,...,c\. (not all of them zero) exist such that 

k 

J2 c i x n )=0 for n = 0,1,.... (3.7.4) 

i=l 

Otherwise the sequences x^\ x^ 2 \ . .., x^ are linearly independent. 

The Casoratian of the k sequences x^\ x^ , . . . , x^ is the k x k determinant 



n (r (1) r (2) r (k A - 



THEOREM 3.7.2 

77ie solutions x^\ x^ 2 \ x^ of the linear homogeneous difference equation, 

x n +k +bn~ 1 ^x n+ (i c _i) H h^n^n+i +&n 0) a;„ = 0, 71 = 0, 1, . . . , (3.7.6) 

are linearly independent if, and only if, their Casoratian is different from zero for 
n = 0. 

Note that the solutions to Equation (3.7.6) form a /s-dimensional vector space. 
The set {x^ , x^ , . . . , x^ } is a fundamental system of solutions for Equation 
(3.7.6) if, and only if, the sequences a^ 1 ', x^ 2 \ x^ are linearly independent 
solutions of the homogeneous difference Equation (3.7.6). 

THEOREM 3.7.3 

Consider the non-homogeneous linear difference equation 

x n+k +b ( £~ 1} x n+ ( k - 1 ) H h&n^n+i +b ( h ) x n = d n , n = 0,l,... (3.7.7) 

w/jere b$ and d„ are given sequences. Let x^ be the general solution of the corre- 
sponding homogeneous equation 

x n+k + 6^ _1) a;„ + ( fc _i) H h b ( ^x n+1 + b ( °' ] x n = 0, n = 0, 1, . . . , 

and let Xrf* be a particular solution of Equation (3.7.7). Then xffl + Srf' is the 
general solution of Equation (3.7.7). 



T (i) 

L n+1 



(2) 

(2) 
c n+l 



T (*) 

(ft) 
c n+l 



„(!) 



,(2) 



.(*) 

-'n+k-l 



(3.7.5) 
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THEOREM 3.7.4 (Superposition principle) 

Let andx^ be solutions of the non-homogeneous linear difference equations 
x n+k + 6^ _1) a;„ + ( A _i) H h b ( ^x n+1 + b ( °' ] x n = a n , n = 0, 1, . . . , 

and 

x n+k + &k* _1) z„+(A-i) H h b n l) x n+ i + b^ x n = n , n = 0, 1, . . . , 

respectively, where b^ and {a„} and {/?«} are given sequences. Then x^ + x^ 
is a solution of the equation 

x n+k + &k* _1) z„+(A-i) H h b ( ^x n+1 + b ( °' ] x n = a n + f3 n , n = 0,1,.... 



3.7 A HOMOGENEOUS EQUATIONS WITH CONSTANT 
COEFFICIENTS 

The results given below for second-order linear difference equations extend naturally 
to higher order equations. 

Consider the second-order linear homogeneous difference equation, 

a 2 x n+2 + aix n+ i + a x n = 0, (3.7.8) 

where the {a{\ are real constant coef cients with a 2 ao ^ 0. The characteristic 
equation corresponding to Equation (3.7.8) is de ned as the quadratic equation 

a 2 X 2 +a 1 \ + a = 0. (3.7.9) 

The solutions Ai , A2 of the characteristic equation are the eigenvalues or the charac- 
teristic roots of Equation (3.7.8). 

THEOREM 3.7.5 

Let Ai and A2 be the eigenvalues of Equation (3.7.8). Then the general solution of 
Equation (3.7.8) is given as described below with arbitrary constants c\ and c 2 . 

Case 1: Xi ^ X 2 with X\,X 2 6 1( real and distinct roots). 
The general solution is given by x n = c\ A™ + C2A™ . 

Case 2: Ai = A2 £ IK (real and equal roots) . 

The general solution is given by x„ = C\ A™ + C2nA™. 

Case 3: Ai = A2 (complex conjugate roots). 

Suppose that X\ = re 1 ^ . The general solution is given by 

%n = c\r n cos(n0) + c 2 r n sm(n(p). 
The constants {c\, c 2 } are determined from the initial conditions. 
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EXAMPLE The unique solution of the initial-value problem 



F n +2 — F n 

F o = 0, 



+ F n , n = 0,l,. 
Fi=l, 



(3.7.10) 



is the Fibonacci sequence. The equation A 2 = A + 1 has the real and distinct roots 
Ai,2 = lzfc y° . Using Theorem 3.7.5 the solution is 



1 



\/5 \ " ( 1 — %/5 



n = 0, 1,. 



(3.7.11) 



3.7.5 NON-HOMOGENEOUS EQUATIONS 



THEOREM 3.7.6 (Variation of parameters) 

Consider the difference equation, x n +2 + Q n i n +i + Pn%n = 7n> where {a n }, 
{fin}, and {7«} are g/ve« sequences with j3 n ^ 0. Lef a^ 1 ' and x^ be two linearly 
independent solutions of the homogeneous equation corresponding to this equation. 
A particular solution has the component values xff = Xn^Vn^ +Xn^v n 2 ^ where 
the sequences andv^ satisfy the following system of equations: 

x n+l y u n+l u " J ' x n+l y u n+l 
x n+2 y u n + l u " J ' x n+2 y'n+1 



Vn ^j = 0, and 

V n I = In- 



(3.7.12) 



3.7.6 GENERATING FUNCTIONS AND Z TRANSFORMS 

Generating functions can be used to solve initial-value problems of difference equa- 
tions in the same way that Laplace transforms are used to solve initial-value problems 
of differential equations. 

The generating function of the sequence {x n }, denoted by G[x„], is de ned by 
the in nite series 

oo 

G[x n ] = J2 x nS n (3.7.13) 

provided that the series converges for \s\ < r, for some positive number r. The 
following are useful properties of the generating function: 

1. Linearity: G [ax n + c 2 y n ] = c\G [x n ] + c 2 G [y n ] . 



2. Translation invariance: G [x n+ k] = 




3. Uniqueness: G [x n ] = G [y n ] -<=^ x n = y n for n = 0, 1, . . . . 
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The Z -transform of a sequence {x n } is denoted by Z[x n ] and is de ned by the 
in nite series, 

CO 

X r 



(3.7.14) 



n=0 



provided that the series converges for |z| > r, for some positive number r. 

Comparing the de nitions for the generating function and the Z-transform one 
can see that they are connected because Equation (3.7.14) can be obtained from 
Equation (3.7.13) by setting s = z~ l . 



{x„} 



Generating functions for some common sequences 



n + 1 



G[x n ] 



1 - s 



1 — as 



(1 - asY 



d 



ds J 1 



1 



(i- s y 



(l-sY 



dV l 



ds J 1 



{x„} 



sin(jSn) 



cos(/3n) 



a n sin(jSn) 



a™ cos(/3n) 



G [x n ] 



s sin j8 



1 - 2s cos/? + s 2 



1 — s cos j8 
1 - 2s cos/? + s 2 



as sin /3 



1 — 2ascos/? + a 2 s 2 



1 — as cos j8 



1 — 2ascosfi + a?s 2 



^ (G [x„] - x ) 



(G [x n ] - x - SXi) 



1 / k ~ l 
~k G [x n ] - x n s n 



n=0 



3.7.7 CLOSED-FORM SOLUTIONS FOR SPECIAL EQUATIONS 

In general, it is dif cult to nd a closed-form solution for a difference equation which 
is not linear of order one or linear of any order with constant coef cien ts. A few spe- 
cial difference equations which possess closed-form solutions are presented below. 

3.7.7.1 First order equation 

The general solution of the rst-order linear difference equation with variable 
coef cien ts, 

x n+ i - a n x n = /3 n , n = 0,l,..., (3.7.15) 
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is given by 

/n— 1 \ n— 2 / n— 1 



X " = I II ak ) X ° + 5Z I [1 a k)Pm + Pn-l, n = 0, 1, (3.7.16) 

where xo is an arbitrary constant. 

3.7.7.2 Riccati equation 

Consider the non-linear rst-ord er equation, 

a n x n H~ Pn n -. 

X„+l = — -z-, 71 = 0,1,..., (3.7.17) 

where a n , /3 n , 7„, <5„ are given sequences of real numbers with 



7„ ^ and 



fin 

In &n 



^0, n = 0,l,.... (3.7.18) 



The following statements are true: 

1 . The change of variables, 

u n +i 



-y n x n +Sn, n = 0,l, 



(3.7.19) 



U = 1, 

reduces Equation (3.7.17) to the linear second-order equation, 

Un+2 = A„U„ + B n , 71 = 0,1,..., 

u = 1, (3.7.20) 
ui = jox + S , 

where A n = S n+1 + a n ^±i, and B n = (P n -y n - a n S n ) 2^±1. 

2. Leta;( p ' be aparticular solution of Equation (3.7.17). The change of variables, 

1 



(p) 



n = 0,l,..., (3.7.21) 



reduces Equation (3.7.17) to the linear rst-order equation, 

w„+i + C„w„ + D n = 0, n = 0,l,..., (3.7.22) 

where C„ = j—, and £>„ = — ^ 

Pnln ^n^n Pnln ^n^n 
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3. Leta^ 1 ' and x^ be two particular solutions of Equation (3.7.17) with a;! 1 ' ^ 
xffl for n = 0, 1, . . .. Then the change of variables, 

1 n = 0, 1,..., (3.7.23) 



(1) ' (1) (2)' 

rjp rip v ' rip v ' rip v ' 

x n x n x n x n 

reduces Equation (3.7.17) to the linear homogeneous rst-order equation, 

w n+ i + E n w n = 0, n = 0,l,..., (3.7.24) 



where - " 



3.7.7.3 Logistic equation 

Consider the initial-value problem 

x n+1 = rx n (l - ^ ) , n = 0,l,..., (3.7.25) 
a;o = a, with a € [0, k], 
where r and k are positive numbers with r < 4. The following are true: 

1. When r = k = 4, Equation (3.7.25) reduces to 

x n+1 = 4x n - x\. (3.7.26) 

If a = 4sin 2 (#) with 6 £ [0, §], then Equation (3.7.26) has the closed-form 
solution 

x n+1 = 4sin 2 (2™ +1 6>), n = 0,l,..., (3.7.27) 
x = 4sin 2 (<9), withtf € [fJ,|]. 

2. When r = 4 and fc = 1, Equation (3.7.25) reduces to 

x n+1 =4x n -4x 2 n . (3.7.28) 

If a = sin 2 (#) with 9 € [0, f], then Equation (3.7.28) has the closed-form 
solution 

x n+1 =sin 2 (2" +1 #), n = 0,l,..., (3.7.29) 
x =sin 2 (<9), with<9 G [o, |] . 
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3.8 DISCRETE DYNAMICAL SYSTEMS AND 
CHAOS 



A dynamical system described by a function / : M — > M is chaotic if 

1 . / is transitive — that is, for any pair of non-empty open sets U and V in M 

there exists a positive constant k such that f k (U) (~l V" is not empty (here 

/* = / o / o • • • o /); and 
N * ' 

k times 

2. The periodic points of / are dense in M; and 

3. / has a sensitive dependence on initial conditions — that is, there is a positive 
number S (depending only on / and M) such that in every non-empty open 
subset of M there is a pair of points whose eventual iterates under / are sepa- 
rated by a distance of at least 8. 

Some systems depend on a parameter and become chaotic for some values of that 
parameter. There are various routes to chaos, one of them is via period doubling 
bifurcations. 

Let the distance between successive bifurcations of a process be du ■ The limiting 
ratio 5 = lim^_ ) . 00 dk/dk+i is constant in many situations and is equal to Feigen- 
baum's constant 6 « 4.6692016091029. 



3.8.1 CHAOTIC ONE-DIMENSIONAL MAPS 

1. Logistic map: x n+ i = 4x„(l — x„) witha^ £ [0, 1]. 
Solution is x n = ^ — ^ cos[2™ cos _1 (l — 2x<))]. 

2. Tent map: x n+ i = 1 — 2 \x n — \ \ with x$ € [0, 1]. 
Solutionis x n = — cos _1 [cos(2™7ra;o)]. 

3. Baker transformation: x n+ i = 2x n (mod 1) with xq € [0,1]. 
Solutionis x n = — cot -1 [cot(2 n 7ra;o)]. 



3.8.2 LOGISTIC MAP 

Consider u n+ i = f(u„) = au„(l — u„) with a € [0,4]. Note that if < uq < 1 
then < u n < 1. The x ed points satisfy u = f(u) = au(l — u); they are u = 
andu = (a — l)/a. 

1. If a = then u n = 0. 

2. If < a < 1 thenu„ 0. 

3. If 1 < a < 3 then u n — > (a — 1) /a. 

4. If 3 < a < 3.449 . . . then u n oscillates between the two roots of u = /(/(«)) 
which are not roots of u = f{u), that is, u± = (a + 1 ± \J a 2 — 2a — 3) /2a. 
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The location of the nal state is summarized by the following diagram (the horizontal 
axis is the a value). 



0.1 - 



0.5 1 1.5 2 2.5 3 3.5 4 

Minimal values of a at which a cycle with a given number of points appears: 



n 


2" points in a cycle 


minimal a 


1 


2 


3 


2 


4 


3.449490. . . 


3 


8 


3.544090. . . 


4 


16 


3.564407. . . 


5 


32 


3.568750... 


6 


64 


3.56969. . . 


7 


128 


3.56989. . . 


8 


256 


3.569934. . . 


9 


512 


3.569943. . . 


10 


1024 


3.5699451... 


11 


2048 


3.569945557. . . 



3.8.3 JULIA SETS AND THE MANDELBROT SET 

For the function f(x) = x 2 + c consider the iterates of all complex points z, z n +i = 
f(z n ) with zq = z. For each z, either the iterates remain bounded (z is in the 
prisoner set) or they escape to in nity (z is in the escape set). The Julia set J c is the 
boundary between these two sets. Using lighter colors to indicate a "faster" escape 
to in nity , Figure 3.6 shows two Julia sets. One of these Julia sets is connected, the 
other is disconnected. The Mandelbrot set, M, is the set of those complex values 
c for which J c is a connected set (see Figure 3.7). Alternately, the Mandelbrot set 
consists of all points c for which the discrete dynamical system, z n +i = z\ + c with 
zo = 0, converges. 

The boundary of the Mandelbrot set is a fractal. There is not universal agree- 
ment on the de nition of "fractal". One de nition is that it is a set whose fractal 
dimension differs from its topological dimension. 
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FIGURE 3.6 

Connected Julia set for c = — 0.5i (left). Disconnected Julia set for c = 
(Julia sets are the black objects.) 



-f(l+«) (right). 




FIGURE 3.7 

The Mandelbrot set. The leftmost point has the coordinates (—2, 0). 




3.9 GAME THEORY 



3.9.1 TWO PERSON NON-COOPERATIVE MATRIX GAMES 

Matrix games idealize situations with participants having different goals. Given ma- 
trices A = (ciij) and B = (bij) consider a game played as follows. After Al- 
ice chooses action i (one choice out of n possible actions) and simultaneously Bob 
chooses action j (one choice out of m possible actions) Alice and Bob receive a 
payoff of dij and bij, respectively. De ne (i, j) as the outcome of the game. If the 
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players have a mixed or random strategy then Alice selects x T = (xi , x-i , . . . , x n ) 
where x^ corresponds to the probability that she chooses action i and Bob selects 
y T = (2/1,2/2, • • • ,Vm) where yj corresponds to the probability that he chooses 
action j. Here, the players seek to maximize their average payoff; that is, Alice 
wants to maximize x T Ay = ^ . ^ . XiCiijyj and Bob wants to maximize x T By = 

E, Zj •'•'''',;•'/.; • 

If a,ij < a,i> j for all i and j then i * is a dominant strategy for Alice. Similarly, if 
bi,j < bij* foralH and j then j* is a dominant strategy for Bob. An outcome 
is Pareto optimal if, for all i and j, the relation ctj.j. < a,j implies foj-j* > fejj. 

If A + B = then the game is a zero sum game and Bob equivalently is trying 
to minimize Alice's payoff. If A + B ^ then the game is a non-zero sum game and 
there is potential for mutual gain or loss. 

3.9.1 .1 The pure zero sum game 

For a zero sum game, A + B = 0. The outcome (i, j) is an equilibrium if a i j < 
a?? < a? „■ for all i and 7. (Note that this implies 67 . < 677 < 6. 7.) 

1. If («, j) is an equilibrium then max, min, a,j = min, max, a,j = a^j. 

2. For all A, max, min, j < min, max, a,, j . 

3. For some A, there is no equilibrium. For example, if A = [ \ \ ] 
then 1 = max, minj a^j < mhij max, a^j = 2. 

4. For some A, there might be an equilibrium which is not a dominant strategy for 
a player. For example, if A = [If], then the outcome (1,1) is an equilibrium 
with the property that Alice has the dominant strategy i = 1 as 01,1 > 02,1 
and 01,2 > 02,2, but there is no dominant strategy for Bob as 01,1 < 01,2 but 

02,1 > 02,2- 

5. For all A, all outcomes are Pareto optimal as aq j < a,j implies 

hi = ~ a ll > ~ ai >i = 

6. For a given A, there can be multiple equilibria. If (i 1 , j\ ) and (12 , ji ) are each 
an equilibrium then a jjj-j = aj 2 j 2 = a^js = a« 2 ,ii an ^ (*i, J2) and («2,ji) 
are also equilibria. For example, if A = [ | 1 2 j then the outcomes ( 1 , 1 ), ( 1 ,3), 
(3,1) and (3,3) are each an equilibrium. 

7. Order of actions: If Alice chooses her action before Bob (or commits to an ac- 
tion rst) and she chooses i then Bob will choose action 3 /3(i) = arg min,- a,j. 
Hence Alice will choose i = argmaxj a« i( g(j) = argmaxj min, a,j which is 
said to be the maximin strategy. Alternatively, if Bob chooses his action before 
Alice he will choose the minimax strategy j = argmin^ max, a,j. A player 
should never prefer to choose an action rst, but if there is an equilibrium, the 
advantage of taking the second action can be eliminated. 



3 The "arg" function refers to the index. 
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3.9.1 .2 The mixed zero sum game 

The outcome (x, y) is an equilibrium for the mixed zero sum game if 

x T Ay < x J Ay < x T Ay for all x£ S x and all y G S y 
where S x = {x | < xt and £\ x i = and S v = {y I < Vj and 2~2j Vj = 1 }- 

1 . If (x, y) is an equilibrium then 

max min x T Ay = min maxx T Ay = x^Ay. 

2. For all A, there exists at least one mixed strategy equilibrium. If there is 
more than one equilibrium, the average payoff to each player is independent 
of which equilibrium is used. 

3. If mirij J2i x i a i,j < mm j2~3j^« a «,j for all x G S x and max j J2j a i,jUj > 
max, cnjyj for all y G S y then (x, y) is an equilibrium. 

4. If A > then an equilibrium strategy for Alice solves max x v subject to v < 
J2i %iCii,j for a H h w i m J2i x i = 1> and > 0- Here, the optimal value of 
v will correspond to the average payoff to Alice in equilibrium. If x • = Xi/v 
this is equivalent to solving 

Ei I J2i x 'i a i 1 > 1j for all j, 

x, subject to < 
. ' ! x\ > 0, for all i. 

Similarly, if y' = (y[ , . . . , y' n ) is a solution to 

Ei i - . . /E, a i,iV'j < ^ for alii, 
y,- subject to < 

j [ yi>°> fol " all j, 

then y = y'/ Ej 2/j i s the equilibrium strategy for Bob. The payoff to Alice 
in equilibrium is v = 1/ x \ = 1/ 53 ■ . These optimization problems are 
an example of linear programming (see page 280). 

For example, if A = [ I \ ] then the solution to 



maximize x\ + x' 2 subject to 



x[ + 2x' 2 > 1, x[ > 0, 

2x\ + x' 2 > 1, x' 2 > 0, 



is x\ = x 2 = | so the payoff to Alice in equilibrium is | and the equilibrium 

is (X!,X 2 ) = (i, i). 

5. If A is 2 x 2 and 01,1 < 01,2, ai,i < 02,1, «2,2 < 02,1, and 02,2 < ai,2 (so 
neither player has a dominant strategy) then the mixed strategy equilibrium is 

02,1 — «2,2 Ql,2 — Ql,l 



01,2 + 12,1 - ai,i - 02,2 01,2 + 02,1-01,1-02,2, , ; i 

Ol,2 — «2,2 «2,1 — «1,1 

ai,2 + 02,1 - a±,i - 02,2 ' ai,2 + 02,1 - a±,i - 02,2 
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and the payoff to Alice in equilibrium is 

max min > > Xia-ijVj = mm max > > XiCiijVj 

* J * 3 (3.9.2) 

01,202,1 — 01,1^2,2 
Ol,2 + 02,1 - ai,i - 02,2 

For example, if A = [ 3, j ] then the solution is x = y = {\,\) and the payoff 
to Alice in equilibrium is |. 

6. Order of actions: It is never an advantage to take the rst action. However, if 
the rst player uses a mixed strategy equilibrium then the advantages of taking 
the second action can always be eliminated. 



3.9.1 .3 The non-zero sum game 

The outcome (i.j) is a Nash equilibrium if a ^ < for all i and b^ ■ < b^^ 
for all j. For the mixed strategy game the outcome (x, y) is a Nash equilibrium if 
x T Ay < x T Ay for all xG S x and x T Ay < x T Ay for all y € S y . 

1. For all A and B, there exists at least one mixed strategy Nash equilibrium. 

2. For all A and B, max, J2j a i,3Vj < Hi Hj ^i a i,jVj and max i Hi Xihj < 
Hi Hj %ibi,jVj is a necessary and suf cient condition for (x,y) to be a Nash 
equilibrium. For example, if A = [ \ \ ] and B = then there are three 
Nashequihbra: (i) {x = (0, 1), y = (0, 1)}, (ii) {x = (f , §),y = (§, f )}, and 
(hi) {x=(l,0),y = (l,0)}. 

3. For all A and B, if 53 . ciijyj is a constant for all i and J2 i Xibij is a constant 
for all j (i.e., each player chooses an action to make the other indifferent to 
their action) then (x, y) is a Nash equilibrium. 

4. For some A and B if (i i , ji ) and (i 2 , ji ) are each a (pure strategy) Nash equi- 
librium then, unlike the case for a zero sum game, a i 1 j 1 need not equal a , 2 j 2 , 
fojjjj need not equal bi 2 j 2 , and neither (ii, j 2 ) nor («2, ji) need be a Nash 
equilibrium. For example, if A = [ \ \ ] and B = then both of the out- 
comes (1,1) and (2,2) are Nash equilibria yet a i,i ^ 02,2, &i,i ^ &2,2 and 
neither (1,2) nor (2,1) is a Nash equilibrium. 

5. Prisoners' Dilemma: A game in which there is a dominant strategy for both 
players but it is not Pareto optimal. For example, if A = [ }!? \ ] and B = 
[ 1 2 J | ] then the dominant (and equilibrium) outcome is (2,2) since a 2 j > aij 
for all j and 6, 2 > 6, i for all i. Here, Alice and Bob receive a payoff of 5 
although the outcome (1,1) would be preferred by both because each would 
receive a payoff of 10. The name is derived from the possibility that the poten- 
tial jail sentence for two people accused of a joint crime could be constructed 
to create a dominant strategy for both to choose to confess to the crime, yet 
both would serve less jail time if neither confesses. 
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6. Braess Paradox: A game in which the Nash equilibrium has a worse payoff for 
all players than the Nash equilibrium which would result if there were fewer 

possible actions. For example, if A = \\ 5 § 2 1 and B = \ ^ *f 2 6 1 then 

L2064J L124J 

the Nash equilibrium is (3,3) which is worse for both players than the Nash 
equilibrium (2,2) which would occur if the third option for each player was 
unavailable. This paradox was originally constructed to demonstrate that the 
equilibrium distribution of o ws in a traf c network would be preferred by 
everyone if a traf c link, e.g., a bridge, weren't there. 

7. Order of actions: If Alice chooses action i before Bob chooses an action 
then Bob will choose /3(i) = argmaxj6,j and hence Alice will choose 
i = argmax, a i} p^y Alternatively, if Bob chooses an action before Alice, 
he will choose j = argmaxj b a ^j where a(j) = argmax, a,j. Unlike the 
zero sum game there might be an advantage to choosing the action rst, e.g., 
for A = [ \ \ ] and B = [ f \ ] if Alice is rst the outcome will be (1,1) with a 
payoff of 4 to Alice and 3 to Bob. If Bob is rst the outcome will be (2,2) with 
a payoff of 4 to Bob and 3 to Alice. 



3.9.2 VOTING POWER 

Matrix games implicitly exclude the possibility of binding agreements among the 
players to resolve their differing goals. When such agreement exist, it is sometimes 
possible to quantify the relative power of the players. 

3.9.2.1 Voting power de nitions 

A weighted voting game is represented by the vector [q; w 1 , w<i , . . . , w n ] ; this means: 

1. There are n players. 

2. Player i has w, votes (with w, > 0). 

3. A coalition is a subset of players. 

4. A coalition S is winning if J2 ieS Wi > q, where q is the quota. 

5. A game is proper if | ^ w, < q. 

A player 

1 . can have veto power: no coalition can win without this player 

2. is a dictator: has more votes than the quota 

3. is a dummy: cannot affect any coalitions 



3.9.2.2 Shapley-Shubik power index 

Consider all permutations of players. Scan each permutation from beginning to end; 
add together the votes that each player contributes. Eventually a total of at least q 
will be arrived at, this occurs at the pivotal player. The Shapley-Shubik power index 
{(p) of player i is the number of permutations for which player i is pivotal, divided 
by the total number of permutations. 
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EXAMPLE 

1. Consider the [5; 4, 2, 1, 1] game; the players are {A,B,C,D}. 

2. For the 4! = 24 permutations of four players the pivotal player is underlined: 

ABCD BACD CABD DABC 

ABDC BADC CADB DACB 

ACBD BCAD CBAD DBAC 

ACDB BCD A CBDA DBCA 

ADBC BDAC CDAB DCAB 

ADCB BDCA CDBA DCBA 

3. Hence player A has power 4>(A) = || = 0.75. 

4. The other three players have equal power of ^ « 0.083. 



3.9.2.3 Banzhaf power index 

Consider all 2 N possible coalitions of players. For each coalition, if player i can 
change the winningness of the coalition, by either entering it or leaving it, then i is 
marginal or swing. The Banzhaf power index (/?) of player i is proportional to the 
number of times he is marginal; the total power of all players is 1. 

EXAMPLE 

1. Consider the [5; 4, 2, 1, 1] game; the players are {A,B,C,D}. 

2. There are 16 subsets of four players; each player is "in" (I) or is "out" (0) of a coalition. 
For each coalition the marginal players are listed (in total there are 20 marginal players). 

^ {} 1 ^ {B,C,D} 

1 => {A} I I => {A,D} 

10 => {A} I I => {A,C} 

I I => {A} I I I => {A} 

10 => {A} I I => {A,B} 

I I => {A} I I I => {A} 

110 => {A} I I I => {A} 

I I I => {A} I I I I => {A} 

3. Player A is marginal 14 times, and has power /3(A) = || = 0.7. 

4. The players B, C, and D are each marginal 2 times and have equal power of = 0.1. 



3.9.2.4 Voting power examples 

1 . For the game [5 1 ; 49 , 48 , 3] the winning coalitions are: {1,2, 3}, {1,2}, {1,3}, 
and {2, 3}. These are the same winning coalitions as the game [3; 1, 1, 1]. 
Hence, all players have equal power by either index, even though the number 
of votes each player has is different. 

2. The original EEC (1958) had France, Germany, Italy, Belgium, The Nether- 
lands, and Luxembourg. They voted as [12; 4, 4, 4, 2, 2, 1]. Therefore: 

^=-1(14,14,14,9,9,0) and = ^-(5,5,5,3,3,0). (3.9.3) 
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3. The UN security council has 15 members. The ve permanent members have 
veto power. For a motion to pass, it must be supported by at least 9 mem- 
bers of the council and it must not be vetoed. A game representation is: 
[39; 7, 7, 7, 7, 7, 1,1, 1,1, 1 , 1, 1,1, 1,1 ]. 

5 members 10 members 

(a) Shapley-Shubik powers: of each permanent member <j> ma j or = ?s 
0.196, of each minor member (j> m i nor = -^45 ~ 0.002. 

(b) Banzhaf powers: /? major = ±§§ a 0.167 and /? minor = ^ a 0.017. 



4. Changing the quota in a game may change the powers of the players: 

(a) For [6; 4, 3, 2] have <j> = 1(4, 1, 1). 

(b) For [7;4,3,2] have^ = |(1, 1,0). 

(c) For [8; 4, 3, 2] have ^ = f (1,1,1). 



5. For the n-player game [q; a, 1,1,1,1,..., 1] with 1 < a < g < n we nd 

^major = a/ H and ^minor = (n - a)/n(n - 1). 

6. Four-person committee, one member is chair. Use majority rule until dead- 
lock, then chair decides. This is a [3; 2, 1, 1, 1] game so that <j> = |(3, 1, 1, 1). 

7. Five-person committee, with two co-chairs. Need a majority, and at least one 
co-chair. This is a [7; 3, 3, 2, 2, 2] game so that <f> = ^(3, 3, 2, 2, 2) and = 

2g(7, 7, 5, 5, 5). 

8. For the game [7; 5, 3, 3, 1] the powers are <j> = = ^(5, 3, 3, 1). 



3.10 OPERATIONS RESEARCH 



Operations research integrates mathematical modeling and analysis with engineering 
in an effort to design and control systems. 



3.10.1 LINEAR PROGRAMMING 

Linear programming (LP) is a technique for modeling problems with linear objective 
functions and linear constraints. The standard form for an LP model with n decision 
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variables and to resource constraints is 



Minimize cjXj 



Subject to < 



Xj > for j = 1, 



a n'" 

Li=i 



6- fori = 1, 



{objective function), 

, n, (non-negativity requirement), 
, to, (constraint functions), 

(3.10.1) 



where Xj is the amount of decision variable j used, Cj is decision j's per unit contri- 
bution to the objective, Oy is decision j's per unit usage of resource i, and 6, is the 
total amount of resource i to be used. 

Let x represent the (n x 1) vector (x\,X2, • • • ,x n ) J ', c the (n x 1) vector 
(ci,C2,--- ,c„) T , b the (to x 1) vector (6i , 62, ■ ■ ■ , b m ) T > ^4 the (to x n) matrix 
(dij), and A.j the (n x 1) column of A associated with xj. Then the standard model, 
written in matrix notation, is "minimize c T x subject to Ax = b and x > 0". A vector 
x is called feasible if, and only if, Ax = b and x > 0. 



3.10.1.1 Modeling in LP 

LP is an appropriate modeling technique if the following four assumptions are satis- 
ed by the situation: 

1 . All data coef cients are known with certainty. 

2. There is a single objective. 

3. The problem relationships are linear functions of the decisions. 

4. The decisions can take on continuous values. 

Branches of optimization such as stochastic programming, multi-objective program- 
ming, non-linear programming, and integer programming have developed in opera- 
tions research to allow a richer variety of models and solution techniques for situa- 
tions where the assumptions required for LP are inappropriate. 

1 . Product mix problem — Consider a company that has three products to sell. 
Each product requires four operations and the per unit data are given in the 
following table: 



Product 


Drilling 


Assembly 


Finishing 


Packing 


Pro t 


A 


2 


3 


1 


2 


45 


B 


3 


6 


2 


4 


90 


C 


2 


1 


4 


1 


55 


Hours available 


480 


960 


540 


320 





Let xa,xb, and xc represent the number of units of A, B, and C manufac- 
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tured daily. A model to maximize profit subject to the labor restrictions is 



Maximize 45a; a + 90a; b + 55xc (total profit), 

' 2x A + 3x B + 2x c < 480 (drilling hours), 
3xa + Qxb + lxc < 960 (assembly hours), 
Subject to: ^ la;^ + 2xb + 4xc < 540 (finishing hours), 
2xa + 4:Xb + laic < 320 (packing hours), 

xa > 0, xb > 0, xc > 0. 



(3.10.2) 



2. Maximum flow through a network — Consider the directed network in Fig- 
ure 3.8. Node S is the source node and node T is the terminal node. On 
each arc shipping material up to the arc capacity Cy is permitted. Material is 
neither created nor destroyed at nodes other than S and T. The goal is to max- 
imize the amount of material that can be shipped through the network from 
S to T. Letting Xjj represent the amount of material shipped from node i to 
node j, a model that determines the maximum flow is shown below. 




Maximize xyr + ^3T + %at, 

XS1 = Xi 3 +X 14 +Xit 
XS2 = X 2 3 + X 2 4 
Subject to ^ X13 + X23 = X3T 

XSA + X24 + X\4 = X4T 



(node 1 conservation), 
(node 2 conservation), 
(node 3 conservation), 
(node 4 conservation), 



(3.10.3) 



< Xu < Ca for all pairs (arc capacity). 



3.1 0.1 .2 Transformation to standard form 

Any LP model can be transformed to standard form as follows: 
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Original model 


Standard form 


change "maximize objective" 


to "minimize objective" 


multiply Cj by — 1 


change "<" constraint 


to "=" constraint 


n 

add slack variable(s) to ^ ®ijXj < bi 
j=i 


n 

(for example: ^ UijXj + 5", = 6,.) 

3 = 1 


change ">" constraint 


to "=" constraint 



subtract surplus variable(s) from ^ > h 

n 

(for example: UjjXj — Ui = 6«) 

3=2- 



LP requires that the slack and surplus variables are non-negative; therefore, deci- 
sions are feasible to the new constraint if, and only if, they are feasible to the original 
constraint. All slack and surplus variables have cj =0. 

3.10.1.3 Solving LP models: simplex method 

Assume that there is at least one feasible x vector, and that A has rank m. Geo- 
metrically, because all constraints are linear, the set of feasible x forms a convex 
polyhedral set (bounded or unbounded) that must have at least one extreme point. 
The motivation for the simplex method for solving LP models is the following: 

For any LP model with a bounded optimal solution, an optimal solution 
exists at an extreme point of the feasible set. 

Given a feasible solution x, let x B be the components of x with xj > and x N 
be the components with xj = 0. Associated with x B , de ne B as the columns of A 
associated with each xj in x B . For example, \ixi,X4,, and Si are positive in x, then 
x B = (x2,X4, Si) T , and B is the matrix with columns A. 2, A.4, A.s 1 . De ne N as 
the remaining columns of A, i.e., those associated with x N . A basic feasible solution 
(BFS) is a feasible solution where the columns of B are linearly independent. The 
following theorem relates a BFS with extreme points: 

A feasible solution x is at an extreme point of the feasible region if, and 
only if, x is a BFS. 

The following simplex method nds an optimal solution to the LP by ndin g the 
optimal partition of x into x B and x N : 

Step (1) Find an initial basic feasible solution. De ne x B , x N , B, N, c B , and c N as 
above. 
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Step (2) Compute the vector c' = (c N - c B B' 1 N). If c'j > for all j, then 
stop; the solution x B = B _1 b is optimal with objective value c B B~ 1 b. 
Otherwise, select the variable xj in x N with the most negative c'j value, 
and go to Step (3). 

Step (3) Compute A[j = B^A.j. If A[j < for all j, then stop; the problem 
is unbounded and the objective can decrease to — oo. Otherwise, compute 

b'- 

b' = B J b and nd min —p. Assume the minimum ratio occurs in 

>■■',; " 

row r. Insert xj into the r th position of x B , take the variable that was in this 
position, and move it to x N . Update B, N, c B , and c N accordingly. Return 
to Step (2). 

Ties in the selections in Steps (2) and (3) can be broken arbitrarily. The unbound- 
edness signal suggests that the model is missing constraints or that there has been an 
incorrect data entry or computational error, because, in real problems, the pro t or 
cost cannot be unbounded. For maximization problems, only Step (2) changes. The 
solution is optimal when c'j < for all j, then choose the variable with the maximum 
c'j value to move into x B . Effective methods for updating B~ l in each iteration of 
Step (3) exist to ease the computational burden. 

To nd an initial basic feasible solution de ne a variable Ai and add this variable 
to the left hand side of constraint i transforming to a ij + ^-i = The new 

constraint is equivalent to the original constraint if, and only if, Ai = 0. Also, 
because A t appears only in constraint i and there are to Ai variables, the columns 
corresponding to the Ai variables are of rank to. We now solve a "new" LP model 
with the adjusted constraints and the new objective "minimize J]™ 1 A". If the 
optimal solution to this new model is 0, the solution is a basic feasible solution to the 
original problem and we can use it in step (1). Otherwise, no basic feasible solution 
exists for the original problem. 

3.10.1.4 Solving LP models: interior point method 

An alternative method to investigating extreme points is to cut through the middle 
of the polyhedron and go directly towards the optimal solution. Extreme points, 
however, provide an ef cient method of determining movement directions (Step (1) 
of simplex method) and movement distances (Step (2) of simplex method). There 
were no effective methods on the interior of the feasible set until Karmarkar's method 
was developed in 1984. The method assumes that the model has the following form: 
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Minimize 



/ n 



Subject to 



fori = 1, 



(3.10.4) 



1, 



Xj > 0, 



for j = 1, 



Also, assume that the optimal objective value is and that xj = 1/n for j = 
1, • • • , n is feasible. Any model can be transformed so that these assumptions hold. 

The following centering transformation, relative to the k th estimate of solution 
vector x*, takes any feasible solution vector x and transforms it to y such that the 



rp . j rpk 



Let 



x* is transformed to the center of the feasible simplex: y^ = , ( 

Diag(x*) represent an n x n matrix with off-diagonal entries equal to and the 
diagonal entry in row j equal to x 1 -. The formal algorithm is as follows: 

Step (1) Initialize x® = 1/n and set the iteration count k = 0. 

n 

Step (2) If ^ XjCj is suf ciently close to 0, then stop; x* is optimal. Otherwise go 

j'=i 
to Step (3). 

Step (3) Move from the center of the transformed space in an improving direction 
using 



„k+l 



1 1 

n n 



0(1 - P T (PP T )- 1 P)[Dmg(x k )]c l 
\\C p \Wn(n-l) 



where ||C P || is the length of the vector (I - P T (PP T )- 1 P)[Diag(x fc )]c T , 
P is an (m + 1) x n matrix whose rst m rows are A[Diag(x*)] and whose 
last row is a vector of l's, and 6 is a parameter that must be between 
and 1. Go to Step (4). 

Step (4) Find the new point x k+1 in the original space by applying the inverse trans- 
formation of the centering transformation to y h+1 . Set k = k + 1 and return 
to Step (2). 



The method is guaranteed to converge to the optimal solution when 8 



j is used. 



3.10.2 DUALITY AND COMPLEMENTARY SLACKNESS 

De ne yi as the dual variable (shadow price) representing the purchase price for a 
unit of resource i. The dual problem to the primal model (maximize objective, all 
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constraints of the form "<") is 

m 

Minimize bit/i 



i=l 
/■ m 



Subject to < 



\^ f . . (3-10.5) 

2_^ a ijVi> c i for j = 1, . . . ,n, 

i=l 



Di > 0, fori = 1 



The objective minimizes the amount of money spent to obtain the resources. 
The constraints ensure that the marginal cost of the resources is greater than or equal 
to the marginal pro t for each product. 

The following results link the dual model (minimization) with its primal model 
(maximization). 

1 . Weak duality theorem: Assume that x and y are feasible solutions to the re- 
spective primal and dual problems. Then 

n m 

j=l i=l 

2. Strong duality theorem: Assume that the primal model has a nite optimal 
solution x* . Then the dual has a nite optimal solution y * , and 

n m 

J2 c i x *i = J2 bi yi- 

3. Complementary slackness theorem: Assume that x and y are feasible solutions 
to the respective primal and dual problems. Then, x is optimal for the primal 
and y is optimal for the dual if and only if: 



hi — a ij x j I = 0, for i = 1, • • • , m, and 
i=i / 

^2 a « 'Vi ~ c i J = °' for j = 1, • • • , n. 



(3.10.6) 



© 2003 by CRC Press LLC 



3.10.3 LINEAR INTEGER PROGRAMMING 



Linear integer programming models result from restricting the decisions in linear 
programming models to be integer valued. The standard form is 

n 

Minimize ^ CjXj (objective function), 

j'=i 

Xj > 0, and integer for j = 1, . . . , n, (3.10.7) 

n 

aijXj =bi for i = 1, . . . , m (constraint functions). 

j'=i 

As long as the variable values are bounded, then the general model can be trans- 
formed into a model where all variable values are restricted to either or 1 . There- 
fore, algorithms that can solve 0-1 integer programming models are suf cient for 
most applications. 



Subject to 



3.10.4 BRANCH AND BOUND 

Branch and bound implicitly enumerates all feasible integer solutions to nd the 
optimal solution. The main idea is to break the feasible set into subsets (branching) 
and then evaluate the best solution in each subset or determine that the subset cannot 
contain the optimal solution (bounding). When a subset is evaluated, it is said to 
he, fathomed. The following algorithm performs the branching by partitioning on 
variables with fractional values and uses a linear programming relaxation to generate 
a bound on the best solution in a subset: 

Step (1) Assume that a feasible integer solution, called the incumbent, is known 
whose objective function value is z (initially, z may be set to in nity if no 
feasible solution is known). Set p, the subset counter, equal to 1. Set the 
original model as the rst problem in the subset list. 

Step (2) If p = 0, then stop. The incumbent solution is the optimal solution. Other- 
wise go to Step (3). 

Step (3) Solve the LP relaxation of the p th problem in the subset list (allow all integer 
valued variables to take on continuous values). Denote the LP objective 
value by v. If v > z or the LP is infeasible, then set p = p — 1 (fathom by 
bound or infeasibility), and return to Step (2). If the LP solution is integer 
valued, then update the incumbent to the LP solution, set z = min(z,v) 
and p = p — 1, and return to Step (2). Otherwise, go to Step (4). 

Step (4) Take any variable xj with fractional value in the LP solution. Replace prob- 
lem p with two problems created by individually adding the constraints 
Xj < [xj\ and Xj > \xj~\ to problem p. Add these two problems to the 
bottom of the subset list replacing the p th problem, set p = p + 1, and go to 
Step (2). 
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3.10.5 NETWORK FLOW METHODS 



A network consists of N, the set of nodes, and A, the set of arcs. Each arc 
de nes a connection from node i to node j. Depending on the application, arc 
may have an associated cost and upper and lower capacity on o w. 

Decision problems on networks can often be modeled using linear programming 
models, and these models usually have the property that solutions from the simplex 
method are integer valued (the total unimodularity property). Because of the under- 
lying graphical structure, more ef cient algorithms are also available. We present 
the augmenting path algorithm for the maximum o w problem and the Hungarian 
method for the assignment problem. 

3.10.5.1 Maximum o w 

Let Xij represent the o w on arc (i, j), Cij the o w capacity of (i, j), S be the source 
node, and T be the terminal node. The maximum o w problem is to ship as much 
o w from S to T without violating the capacity on any arc, and all o w sent into 
node i must leave i (for i ^ S, T). The following algorithm solves the problem by 
continually adding o w-carrying paths until no path can be found: 

Step (1) Initialize = for all 

Step (2) Find a o w-augmenting path from S to T using the following labeling 
method. Start by labeling S with a* . From any labeled node i, label node 
j with the label i if j is unlabeled and Xij < c^j (forward labeling arc). 
From any labeled node i, label node j with the label i if j is unlabeled 
and Xji > (backward labeling arc). Perform labeling until no additional 
nodes can be labeled. If T cannot be labeled, then stop. The current x y 
values are optimal. Otherwise, go to Step (3). 

Step (3) There is a path from S to T where o w is increased on the forward labeling 
arcs, decreased on the backward labeling arcs, and gets more o w from S 
to T. Let F be the minimum of c y - — x^j over all forward labeling arcs and 
of x^ over all backward labeling arcs. Set iy = + F for the forward 
arcs and x^j = x^j — F for the backward arcs. Return to Step (2). 

The algorithm terminates with a set of arcs with x^j = c^j and if these are 
deleted, then S and T are in two disconnected pieces of the network. The algorithm 
nds the maximum o w by nding the minimum capacity set of arcs that disconnects 
S and T (minimum capacity cutset). 



3.10.6 ASSIGNMENT PROBLEM 

Consider a set J of jobs and a set / of employees. Each employee can do 1 job, and 
each job must be done by 1 employee. If job j is assigned to employee i, then the 
cost to the company is Cy . The problem is to assign employees to jobs to minimize 
the overall cost. 
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This problem can be formulated as an optimization problem on a bipartite graph 
where the jobs are one part and the employees are the other. Let m be the cardinality 
of J and I (they must be equal cardinality sets, otherwise there is no feasible solu- 
tion), and let C be the m x m matrix of costs c y -. The following algorithm solves 
for the optimal assignment. 

Step (1) Find li = min c y - for each row i. Let c y - = c y - — Find rij = min c y - for 

3 i 

each column j. Let c y - = c y - — rij. 

Step (2) Construct a graph with nodes for S, T, and each element of the sets J 
and /. Construct an arc from S to each node in /, and set its capacity to 1. 
Construct an arc from each node in J to T, and set its capacity to 1. If 
Cij = 0, then construct an arc from i £ I to j £ J, and set its capacity 
to 2. Solve a maximum o w problem on the constructed graph. If m units 
of o w can go through the network, then stop. The maximum o w solution 
on the arcs between I and J represents the optimal assignment. Otherwise, 
go to Step (3). 

Step (3) Update C using the following rules based on the labels in the solution to 
the maximum o w problem: Let L / and Lj be the set of elements of I and 
J respectively with labels when the maximum o w algorithm terminates. 

Let S = min c y -; note that S > 0. For i £ Lj and j £ ( J — Lj), 

ieL I ,je(j-L J ) 

set Cij = — S. For i £ (I — Lj) and j £ Lj, set c y - = c,j + S. Leave 
all other c y values unchanged. Return to Step (2). 

In Step (3), the algorithm creates new arcs, eliminates some unused arcs, and 
leaves unchanged arcs with Xy = 1. When returning to Step (2), you can solve the 
next maximum o w problem by adding and deleting the appropriate arcs and starting 
with the o ws and labels of the preceding execution of the maximum o w algorithm. 



3.10.7 DYNAMIC PROGRAMMING 

Dynamic programming is a technique for determining a sequence of optimal deci- 
sions for a system or process that operates over time and requires successive de- 
pendent decisions. The following ve properties are required for using dynamic 
programming: 

1 . The system can be characterized by a set of parameters called state variables. 

2. At each decision point or stage of the process, there is a choice of actions. 

3. Given the current state and the decision, it is possible to specify how the state 
will evolve before the next decision. 

4. Only the current state matters, not the path by which the system arrived at the 
state (termed time separability). 

5. An objective function depends on the state and the decisions made. 

The time separability requirement is necessary to formulate a functional form 
for the decision problem. Let / t * (i) denote the optimal objective value to take the 
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system from stage t to the end of the process, given that the process is now in state 
i, A t (i) is the set of decisions possible at stage t and state i, aj is a particular action 
in A t (i), A it (a.j) is the change from state i between stage t and stage t + 1 based 
on the action taken, and c«(aj) is the immediate impact on the objective of taking 
action aj at stage t and state i. 

The principle of optimality states: 

An optimal sequence of decisions has the property that, whatever the 
initial state and initial decision are, the remaining decisions must be an 
optimal policy based on the state resulting from the initial information. 

Using the principle, Bellman's equations are 
/**(*)= min. (//(«) = min {c«(aj) + f? +1 [A it ( aj )}} I , foralH. 



3.10.8 SHORTEST PATH PROBLEM 

Consider a network (N, A) where N is the set of nodes, A the set of arcs, and dij 
represents the "distance" of traveling on arc (i, j) (if no arc exists between i and 
j, dij = oo). For any two nodes R and S, the shortest path problem is to nd the 
shortest distance route through the network from R to S. Let the state space be N 
and a stage representing travel along one arc. / * (i) is the optimal distance from node 
i to S. The resultant recursive equations to solve are 

/*(»)= min [dy+rO')], for alii. 

Dijkstra 's algorithm can be used successively to approximate the solution to the 
equations when d,j > for all (i, j). 

Step (1) Set f*(S) = and f*(i) = d iS for all i e N. Let P be the set of 
permanently labeled nodes; P = {S}. Let T = N — P be the set of 
temporarily labeled nodes. 

Step (2) Find i G T with f*(i) = min/*(j). Set T = T - {{} and P = P U {i}. 

If T = (the empty set), then stop; f*(R) is the optimal path length. 
Otherwise, go to Step (3). 

Step (3) Set f*(j) = mm[f*(j)J*(i) + d^} for all j £ T. Return to Step (2). 



3.10.9 HEURISTIC SEARCH TECHNIQUES 

Heuristic search techniques are commonly used in algorithms for combinatorial op- 
timization problems. The method starts with an initial vector Xo and attempts to nd 
improved solutions. De ne x to be the current solution vector, /(x) to be its objective 
value, and N(x) to be its neighborhood. For the remainder of this section, assume 
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that we seek to nd the minimum value of /(x). In each iteration of a neighborhood 
search algorithm, we generate a number of solutions x' € N(x), and compare /(x) 
with each /(x'). If /(x') is a better value than /(x), then we update the current 
solution to x' (termed accepting x' ) and we iterate again searching from x'. The 
process continues until none of the generated neighbors of the current solution yield 
lower solutions. Common improvement procedures such as pairwise interchange 
and "A;-opt" are speci c instances of neighborhood search methods. Note that at 
each iteration, we move to a better solution or we terminate with the best solution 
seen so far. 

The key issues involved in designing a neighborhood search method are the def- 
inition of the neighborhood of x, and the number of neighbors to generate in each 
iteration. When the neighborhood of x is easily computed and evaluated, then one 
can generate the entire neighborhood to ensure nding a better solution if one exists 
in the neighborhood. It is also possible to generate only a portion of the neighbor- 
hood (however, this could lead to premature termination with a poorer solution). In 
general, deterministic neighborhood search can only guarantee ndin g a local mini- 
mum solution to the optimization problem. One can make multiple runs, each with 
different initial solution vectors, to increase the chances of nding the global mini- 
mum solution. 

3.10.9.1 Simulated annealing (SA) 

Simulated annealing is neighborhood search method that uses randomization to avoid 
terminating at a locally optimal point. In each iteration of SA, we generate a single 
neighbor x' of x. If /(x') < /(x), then we accept x'. Otherwise, we accept x' with a 
probability that depends upon /(x') — /(x), and a non-stationary control parameter. 
De ne the following notation: 

1 . Cu is the k th control parameter, 

2. Lk is the maximum number of neighbors evaluated while the k th control pa- 
rameter is in use, and 

3. Ik is the counter for the number of solutions currently evaluated at the k lh 
control parameter. 

To initialize the algorithm, we assume that we are given the sequences {C u} (termed 
the cooling schedule) and {L^} such that Cu — > as k — > oo, and an initial value x . 
The SA algorithm is (assuming that we are trying to minimize /(x)): 

Step (1) Set x = x , k = 1 and I k = 0. 

Step (2) Generate a neighbor x' of x, compute /(x') and increment 1^ by 1. 
Step (3) If /(x') < /(x), then replace x with x' and go to Step (5). 



Step (4) If /(x') > /(x), then with probability exp ( /W c /(x) ) , replace x with x'. 



Step (5) If Ik = Lk> then increment A; by 1, reset 1^ = 0, and check for the termina- 
tion criterion. If the termination criterion is met, then stop, x is the solution; 
if not, then go to Step (2). 
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This SA description uses an exponential form for the acceptance probability for 
inferior solutions; this was proposed by Metropolis et al. The algorithm terminates 
when Cu approaches 0, or there has been no improvement in the solution over a 
number of Cu values. In the above SA description we only store the current solution, 
not the best solution encountered. In practice, however, in Step (2), we also compare 
/(x') with an incumbent solution. If the incumbent solution is worse, then we replace 
the incumbent with x' ; otherwise we retain the current incumbent. Note that SA only 
generates one neighbor of x in each iteration. However, we may not accept x ' and 
therefore may generate another neighbor of x. 

Several issues related to parameter setting, neighborhood de nition , and solu- 
tion updating must be resolved when implementing SA. For example, the sequences 
of Cu and L\. values are critical for successful application. If Cu goes to zero too 
quickly, then the algorithm can easily get stuck in a local minimum solution. If C i is 
large and tends to zero too slowly, then the algorithm requires more computation 
to achieve convergence. To date, the majority of the analytical results and empirical 
studies in the SA literature consider the effects of the Cu schedule, the Lj. schedule, 
and the initial solution x . The method can be shown to converge with probability 
one to the set of optimal solutions as long as Cu — > as k — > oo and J2^ < co. 

3.10.9.2 Tabu search 

Tabu search (TS) is similar to simulated annealing. A problem in SA is that one can 
start to climb out of a local minimum solution, only to return via a sequence of "bet- 
ter" solutions that leads directly back to where the algorithm has already searched. 
Also, the neighborhood structure may permit moving to extremely poor solutions 
where one knows that no optimal solutions exist. Finally, the modeler may have in- 
sight on where to look for good solutions and S A has no easy mechanism for enabling 
the search of speci c areas. Tabu search tries to remedy each of these de ciencies. 

The key terminology in TS is 5(x) , the set of moves from x. This is similar to the 
neighborhood of x, and is all the solutions that you can get to from x in one move. The 
terminology "move" is similar to the "step" in simulated annealing, but can be more 
general because it can be applied to both continuous and discrete variable problems. 
Let s be a move in 5(x). For example, consider a 5-city traveling salesman problem 
where x is a vector containing the sequence of cities visited, including the return to 
the initial city. Let x = (2,1,5, 3, 4, 2). If we de ne a move to be an "adjacent 
pairwise interchange", then the set of moves S(x) is: 

{(1,2, 5,3,4,1), (2,5, 1,3,4,2), (2, 1,3,5,4,2), (2, 1,5, 4,3,2), (4, 1,5,3,2, 4)} 

For another example, if we use a standard non-linear programming direction-step 
size search algorithm, then one can construct a family of moves of the form S(x) = 
x+ud. Here, u is a step size scalar and d is the direction of movement and the family 
depends on the values of u and d selected. 

To run the method, de ne T as the tabu set. This is a set of moves that one 
does not want the method to use. Also, de ne OPT to be the function that selects a 
particular s € S(x) that creates an eventual improvement in the objective. Then 

Step (1) Find initial incumbent x . Setx = x*, k = 0, T = <f>. 
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Step (2) If S(x) —T = (j>, then go to Step (4). Otherwise set k = k + 1 and select 
s k G S(x) - T such that s k (x) = OPT(s \ s £ S(x) - T). 

Step (3) Letx = s^(x). If /(x) < /(xo), thenxo = x. 

Step (4) If a chosen number of iterations has elapsed either in total or since x was 
last improved, or if S(x) — T = <j> from Step (2), then stop. Otherwise, 
update T (if necessary) and return to Step (2). 

The method is more effective if the user understands the solution space and can guide 
the search somewhat. Often the tabu list contains solutions that were previously 
visited or solutions that would reverse properties of good solutions. Early in the 
method, it is important that the search space is evaluated in a coarse manner so 
that one does not skip an area where the optimal solution is located. Management 
of the tabu list is also critical; the list will be expanding and contracting as you 
obtain more information about the solution space. The ability to solve the OPT 
problem quickly in Step (2) also helps the method by enabling the evaluation of 
more candidate solutions. Tabu search can move to inferior solutions temporarily 
when OPT returns a solution that has a worse objective value than /(x) and, in fact, 
this happens every time when x is a local minimum solution. For more details, see 
Glover. 

3.10.9.3 Genetic algorithms 

A different approach to heuristically solving dif cu It combinatorial optimization 
problems mimics evolutionary theory within an algorithmic process. A population of 
individuals is represented by K various feasible solutions x^ for k = 1, . . . , K. The 
collection of such solutions at any iteration of a genetic algorithm is referred to as a 
generation, and the individual elements of each solution x k are called chromosomes. 
For instance, in the context of the traveling salesman problem, a generation would 
consist of a set of traveling salesman tours, and the chromosomes of an individual 
solution would each represent a city. 

To continue drawing parallels with the evolutionary process, each iteration of 
a genetic algorithm creates a new generation by computing new solutions based on 
the previous population. More speci cally , an individual of the new generation is 
created from (usually two) parent solutions by means of a crossover operator. The 
crossover operator prescribes methodology by which a solution is created by com- 
bining characteristics of the parent solutions. The selection of the crossover operator 
is one of the most important aspects of designing an algorithm. 

The rules for composing a new generation differ among various implementa- 
tions, but often consist of selecting some of the best solutions from the previous 
generation along with some new solutions created by crossovers from the previous 
generation. Additionally, these solutions may mutate from generation to generation 
in order to introduce new elements and chromosomal patterns into the population. 
The objective value of each new solution in the new generation is computed, and the 
best solution found thus far in the algorithm is updated if applicable. The creation of 
the new generation of solutions concludes a genetic algorithm iteration. The algo- 
rithm stops once some termination criteria are reached (e.g., after a speci ed number 
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of generations are evolved, or perhaps if no new best solution was recorded in the 
last q generations). A typical genetic algorithm for minimization is: 



Step (1) Choose a population size K, a maximum number of generations Q, and a 
number of survivors S < K, where K, Q, and S are all integers. Also, 
choose some mutation probability p (typically, p is set to be a small value, 
often close to 0.05). Create some initial set of solutions x*, for k = 
1, . . . ,K, and let Generation consist of these solutions. Calculate the 
objective function of each solution in Generation 0, and let x* with objec- 
tive function /(x*) denote the best such solution. Initialize the generation 
counter i = 0. 

Step (2) Copy the best (according to objective function value) S solutions from Gen- 
eration i into Generation i + 

Step (3) Create the remaining K — S solutions for Generation i + 1 by executing a 
crossover operation on randomly selected parents from Generation i. For 
each new solution x^ created, calculate its objective function value /(x*). 
If f(x k ) < f(x*), then setx* = x k and /(x*) = f(x k ). 

Step (4) For k = 1, . . . , K, mutate solution x^ in Generation i with probability p. 

Calculate the new objective function value f(x k ), and if f(x k ) < /(x*), 
then set x* = x^ and /(x*) = f(x k ). 

Step (5) Set i = i + 1. If i = Q, then terminate with solution x*. Otherwise, return 
to Step 2. 

Genetic algorithm implementations differ because of the application area and 
the processes required by the algorithm. Three speci c processes required by genetic 
algorithms are discussed below. For more details, see Goldberg. 

1 . Creating the initial population — Although often overlooked as an important 
part of executing genetic algorithms, careful consideration should be given to 
the creation of the initial set of solutions for Generation 0. For instance, we 
may employ a rudimentary constructive heuristic to generate a set of good 
initial solutions rather than using some blindly random approach. However, 
care must also be taken to ensure that the set of heuristic solutions generated 
is suf ciently diverse. That is, if all initial solutions are nearly identical, then 
the solutions created in the next generation may closely resemble those of the 
previous generation, thus limiting the scope of the genetic algorithm search 
space. Hence, one may penalize solutions having too close a resemblance to 
previously generated solutions in the initial step. 

2. The crossover process — The crossover operator is the most important consid- 
eration in designing a genetic algorithm. While the selection of the parents for 
the crossover operation is done randomly, preference should be given to parent 
solutions having better quality objective function values (imitating mating of 
the most t individuals, as in evolution theory). However, feasibility restric- 
tions are sometimes implied by the structure of a solution, and must therefore 
apply to the output of the crossover operator. 
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EXAMPLE For example, in the traveling salesman problem, one such feasibility 
restriction requires that a solution must be a permutation of integers. Consider 
the following two parent solutions, where the return to the rst city is implied: 

(1,3,5,2,4,6) and (1,2,3,6,5,4). 

A crossover operator that simply takes the rst three chromosomes from the 
rst parent and the last three chromosomes from the last parent would result in 
the solution (1, 3, 5, 6, 5, 4), which is infeasible to the permutation restriction. 
An alternative operator might modify the foregoing operator with the follow- 
ing modi cation: post-process the solution by replacing repeated chromosomes 
with omitted chromosomes. In the prior example, city 5 is repeated while city 2 
is omitted, and thus one of the following two solutions would be generated: 

(1,3,2,6,5,4) or (1,3,5,6,2,4). 

3. The mutation operator — A common behavior of genetic algorithms executed 
without the mutation operator is that the solutions within the same generation 
converge to a small set of distinct solutions, from which radically different 
(and perhaps optimal) solutions cannot be created via the given crossover op- 
erator. The purpose of the mutation operator is to inject diverse elements into 
future iterations. Generally speaking, the mutation operator is often a small 
change within the solution, such as a pairwise interchange on a solution to the 
traveling salesman problem. However, the mutation operator must generate 
signi can t enough change in the solution to ensure that there exists a chance 
of having this modi cation propagate into solutions in future generations. 
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2.2 ELEMENTARY ALGEBRA 



2.2.1 BASIC ALGEBRA 
2.2.1.1 Algebraic equations 

A polynomial equation in one variable has the form f(x) = where f(x) is a 
polynomial of degree n 

f{x) = a n x n + a n -\x n ~ x + • • • + ci\x + a® (2.2.1) 

and a„ ^ 0. 

A complex number z is a root of the polynomial f(x) if f(z) = 0. A complex 
number z is a root of 'multiplicity k if / \z) = f'(z) = f"(z) = ■ ■ ■ = f^^(z) = 0, 
but / w (z) ^ 0. A root of multiplicity 1 is called a simple root. A root of multiplicity 
2 is called a double root, and a root of multiplicity 3 is called a triple root. 
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2.2.1.2 Roots of polynomials 

1. Fundamental theorem of algebra 

A polynomial equation of degree n has exactly n complex roots, where a dou- 
ble root is counted twice, a triple root three times, and so on. If the n roots of 
the polynomial f(x) are z\, z 2 , ■ ■ ■ , z n (where a double root is listed twice, a 
triple root three times, and so on), then the polynomial can be written as 

f(x) = a n (x - zi)(x - z 2 ) ■ ■ ■ (x - z n ). (2.2.2) 

2. If the coef cie nts of the polynomial, {ao, ai , . . . , a„}, are real numbers, then 
the polynomial will always have an even number of complex roots occurring 
in pairs. That is, if z is a complex root, then so is z. If the polynomial has an 
odd degree and the coef cients are real, then it must have at least one real root. 

3. The coef cients of the polynomial may be expressed as symmetric functions 
of the roots. For example, the elementary symmetric functions {s and their 
values for a polynomial of degree n (known as Viete's formulae), are: 

d n —\ 

S'l = Zi + Z-2 H h z n = 



S-2 = Z L Z 2 + Z 1 Z 3 + Z 2 Z 3 H = ^ ZiZj 



O-n-1 



i>j (2.2.3) 

S„ = Z!Z 2 Z 3 . . .Z n = (-1) , 

a n 

where su is the sum of (^) products, each product combining k factors without 
repetition. 

4. The discriminant of the polynomial is de ned by n^jfe — z j) 2 > where the 
ordering of the roots is irrelevant. The discriminant can always be written as a 
polynomial combination of ao, ai, ■ ■ ■ , a n , divided by a n . 

(a) For the quadratic equation ax 2 + bx + c = the discriminant is - ~t ac ■ 

(b) For the cubic equation ax 3 + bx 2 + cx + d = the discriminant is 

b 2 c 2 - 4b 3 d - 4ac 3 + 18abcd - 27a 2 d 2 



The number of roots of a polynomial in modular arithmetic is dif cult to pre- 
dict. For example 

(a) y 4 + y + 1 = has one root modulo 51: y = 37 

(b) y 4 + y + 2 = has no roots modulo 5 1 

(c) y 4 +y + 3 = has six roots modulo 51: y = {15,27,30,32,44,47} 
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2.2.1.3 Resultants 



Let f(x) = a„x n + a n -\x n + • • • + a\x + ao and g(x) = b m x m + b m -\x m + 
■ ■ - + b\x + bo, where a n ^ and6 TO ^ 0. The resultant of / and is the determinant 
of the (to + n) x (to + n) matrix 



det 



a„_i 

Q>n Q>n—\ 



ao 
ai 







a n a n -i 
b m 



a\ a 
bi b 



'Jm-l 



bo 




(2.2.4) 



J>m b m -\ ... bo 

The resultant of f(x) and g(x) is if and only if f(x) and g(x) have a common root. 
Hence, the resultant of f(x) and f'(x) is zero if and only if f(x) has a multiple root. 

EXAMPLES 



1. Iff(x) 



■ 2x + 3 and g(:r; a) = 4a: 3 + 5a: 2 + 6x + (7 + a), then the resultant 



of f(x) and g(x; a) is 



det 



'12 3 
12 3 
1 2 
4 5 6 

4 5 6 7 + a 





3 

7 + a 




(16 + a) 2 



Note that g(x, -16) = (4x - 3) (x 2 + 2x + 3) = (4x - 3)/(x). 

2. The resultant of ai + 6 and ca + d is da — be. 

3. The resultant of (x + a) 6 and (a; + 6) 6 is (6 - a) 26 . 



2.2.1.4 Algebraic identities 

(a ±6) 2 =a 2 ±2a6 + 6 2 . 

(a ± 6) 3 = a 3 ± 3a 2 6 + 3a6 2 ± 6 3 . 

(a ± bf = a 4 ± 4a 3 6 + 6a 2 6 2 ± 4a6 3 + b 4 . 

a 2 + 6 2 = (a + 6i)(a - W). 

a 4 + 6 4 = (a 2 + V2a6 + b 2 )(a 2 - V2ab + b 2 ). 

a 2 -b 2 = (a-b)(a + b). 

a 3 -b 3 = (a-b)(a 2 +ab + b 2 ). 

a n -b n = (a - b)(a n ~ 1 + a n ~ 2 b +■■■ + (ib"' 2 + 6"" 1 ). 
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(a + b + cf = a 2 + b 2 + c 2 + 2ab + 2ac + 2bc. 

(a + b + cf = a 3 + b 3 + c 3 + 3(a 2 b + ab 2 + a 2 c + ac 2 + b 2 c + 6c 2 ) + 6abc. 

a n +b n = (a + b) (a"' 1 + {-b)a n ~ 2 + (-b) 2 a n - 3 + ■■■ + n odd 



2.2.1 .5 Laws of exponents 

Assuming all quantities are real, a and b positive, and no denominators are zero, then 



a.v 



a x ~ y , (ab) x = a x b x 

1 /a\ x a x 



o » = l,f„ # 0, „-■ = -, (£)■ 

(a x y=a xy , a- = tfa, </ab = <fa~</b, 

fa \fa 



Ya, ay = <faF = {f/af 



b </b' 



2.2.1.6 Proportion 

If £ = £ then ^ = ad = be, ^ = = and = ^=4. 

pa' c </' b (i'o a a+b c+d 

If | = 2> where a, b, c, and d are all positive numbers and a is the largest of the 
four numbers, then a + d > b + c. 



2.2.2 PROGRESSIONS 

2.2.2.1 Arithmetic progression 

An arithmetic progression is a sequence of numbers such that the difference of any 
two consecutive numbers is constant. If the sequence is a i , a-i , . . . a n , where a ,+ 1 — 
a, = d, then au = a\ + (k — l)d and 

a\ + a-2 H h a n = ^ ^2en + (n - l)dj . (2.2.5) 

In particular, the arithmetic progression 1,2, ... ,n has the sum n(n + 1) j2. (See 
page 22.) 

2.2.2.2 Geometric progression 

A geometric progression is a sequence of numbers such that the ratio of any two con- 
secutive numbers is constant. If the sequence is a\,a<i, . . . ,a n , where c^+i/a, = r, 
then au = air* -1 . 

a\ + ci2 + • • • + a„ = < r (2.2.6) 
I nai r = 1. 

If |r| < 1, then the in nite geometric series a\ (1 + r + r 2 + r 3 + • • • ) converges to 
j^r. For example, l+\ + \ + \ + --- = 2. 
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2.2.2.3 Means 

1 . The arithmetic mean of a and b is given by g ^ . More generally, the arithmetic 
mean of a\, a<i, . . . , a n is given by (a\ + + • • • + a n )/n. 

2. The geometric mean of a and b is given by \/ab. More generally, the geometric 
mean of a\, a<i, . . . , a n is given by ^Ja\a2 ■ ■ ■ a n . The geometric mean of n 
positive numbers is less than the corresponding arithmetic mean, unless all of 
the numbers are equal. 

3. The harmonic mean of a and b is given by -r—-. r— = - 

If A, G, and H represent the arithmetic, geometric, and harmonic means of a and b, 
then AH = G 2 . 



2.2.3 DEMOIVRE'S THEOREM 

A complex number a + bi can be written in the form re t9 , where r 2 = a 2 + b 2 and 
tan 9 = b/a. Because e t9 = cos 9 + i sin 9, 

(a + bi) n = r" (cos n9 + i sin n#), 



Vl = cos hisin , k = 0, 1, . . . , n — 1. 

n n 

n/ _, (2k + 1)tt . . (2fc + 1)tt , „ , 

V — 1 = cos 1- ism , fc = 0, 1, . . . , n — 1. 



(2.2.7) 



2.2.4 PARTIAL FRACTIONS 

The technique of partial fractions allows a quotient of two polynomials to be written 
as a sum of simpler terms. 

Let f(x) and g(x) be polynomials and let the fraction be If the degree 

of f(x) is greater than the degree of g(x) then divide f(x) by g(x) to produce a 
quotient q(x) and a remainder r(a;), where the degree of r(x) is less than the degree 
of g(x). That is, = q(x) + Therefore, assume that the fraction has the form 

^r\, where the degree of the numerator is less than the degree of the denominator. 

The techniques used to nd the partial fraction decomposition of depend on the 
factorization of g(x). 



2.2.4.1 Single linear factor 

Suppose that g(x) = (x — a)h(x), where h(a) ^ 0. Then 

r(x) A six] 

-H = — + tH- (2 - 2 - 8) 

where s(a;) can be computed and the number A is given by r(a)/h(a). For example 
(here r(x) = 2x, g(x) = x 2 - 1 = (x — l)(x + 1), h(x) = x + 1, and a = 1): 

x^ — 1 x — 1 £ + 1 
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2.2.4.2 Repeated linear factor 

Suppose that g(x) = (x — a) k h(x), where h(a) ^ 0. Then 



r(x) 



A! 



g(x) x — a (x — a) 2 
for a computable s(x) where 



H h 



s(x) 

(x — a)* /i(x) ' 



4* 

Ak-j 



r(a) 
h(a) ' 
<i / r(x) 



dx \h(x) 
1 d 2 fr{x) 



2! dx 2 VM^) 
1 dP fr(x) 



j\ dxi \h{x) 



(2.2.10) 



(2.2.11) 



2.2.4.3 Single quadratic factor 

Suppose that g(x) = (x 2 + bx + c)h(x), where b 2 - 4c < (so that x 2 + bx + c 
does not factor into real linear factors) and h(x) is relatively prime to x 2 + bx + c 
(that is h(x) and x 2 + bx + c have no factors in common). Then 



r(x) 



Ax + B 



s(x) 



g(x) x 2 + bx + c h(x) 



(2.2.12) 



In order to determine A and B, multiply the equation by g(x) so that there are no 
denominators remaining, and substitute any two values for x, yielding two equations 
for A and B. 

When A and B are both real, if after multiplying the equation by g(x) a root of 
x 2 + bx + c is substituted for x, then the values of A and B can be inferred from this 
single complex equation by equating real and imaginary parts. (Since x 2 + bx + c 
divides g(x), there are no zeros in the denominator.) This technique can also be used 
for repeated quadratic factors (below). 



2.2.4.4 Repeated quadratic factor 

Suppose that g(x) = (x 2 + bx + c-) k h(x), where b 2 — 4c < (so that x 2 + bx + c 
does not factor into real linear factors) and h(x) is relatively prime to x 2 + bx + c. 
Then 

r{x) _ Aix + Bi A 2 x + B 2 ; A 3 x + B 3 
g(x) x 2 + bx + c (x 2 + bx + c) 2 (x 2 + bx + c) 3 

AkX + B k s(x) 

(x 2 + bx + c) k h(x) 

In order to determine Ai and B,, multiply the equation by g(x) so that there are no 
denominators remaining, and substitute any 2k values for x, yielding 2k equations 
for Ai and B,. 
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2.3 POLYNOMIALS 



All polynomials of degree 2, 3, or 4 are solvable by radicals. That is, their roots 
can be written in terms of a nite number of algebraic operations (+, — , x , and -=-) 
and root-taking ( ^~). While some polynomials of higher degree can be solved by 
radicals (e.g., x 10 = 1 is easy to solve), the general polynomial of degree 5 or higher 
cannot be solved by radicals. However, general polynomials of degree 5 and higher 
can be solved using hypergeometric functions. 



2.3.1 QUADRATIC POLYNOMIALS 

The solution of the equation ax 2 + bx + c = 0, where a ^ 0, is given by 

-b ± Vb 2 - 4ac 

x= . (2.3.1) 

2 a 

The discriminant of the quadratic equation is (b 2 — 4ac)/a 2 . Suppose that a, b, and 
c are all real. If the discriminant is negative, then the two roots are complex numbers 
which are conjugate. If the discriminant is positive, then the two roots are unequal 
real numbers. If the discriminant is 0, then the two roots are equal. 



2.3.2 CUBIC POLYNOMIALS 

To solve the equation ax 3 + bx 2 + cx + d = 0, where a ^ 0, begin by making the 
substitution y = x+j^. That gives the equation y 3 + 3py + q = 0, wherep = 3a £~ 2 b 
and q = 2 b s -9abc+27a 2 d _ The discriminant of this polynomial is Ap 3 + q 2 . 

The solutions of y 3 + 3py + q = are given by tya + \/~/3, e^r tya + e^- 
and e^r %fa + e~^~ where 

-q + ^q 2 + 4p 3 -q - V q 2 + Ap 3 
a = ^ and /3 = ^ . (2.3.2) 

Suppose that p and q are real numbers. If the discriminant is positive, then one 
root is real, and two are complex conjugates. If the discriminant is 0, then there are 
three real roots, of which at least two are equal. If the discriminant is negative, then 
there are three unequal real roots. 

2.3.2.1 Trigonometric solution of cubic polynomials 

In the event that the roots of the polynomial y 3 + 3py + q = are all real, meaning 
that q 2 + Ap 3 < 0, then the expressions above involve complex numbers. In that case 
one can also express the solution in terms of trigonometric functions. De ne r and 6 
by 

r = y^p 3 " and 6 = cos" 1 (2.3.3) 
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Then the three roots are given by 

2^Fcos?, 2^Fcos^4^, and 2 s/F cos ^-±7-^ • (2.3.4) 



2.3.3 QUARTIC POLYNOMIALS 

To solve the equation ax 4 + bx 3 + ex 2 + dx + e = 0, where a ^ 0, start with the 
substitution y = x + j^. This gives y 4 + py 2 + qy + r = 0, where p = Sa %~ 3b , 

„ _ b s -4abc+Sa 2 d „_ j „ _ 16ab 2 c+256a s e-3b 4 -64a 2 bd 

1 - 8«3 ,anar- 256a4 . 

The cubic resolvent of this polynomial is de ned as t 3 — pt — At t + {Apr — q) = 
0. If u is a root of the cubic resolvent (see previous section), then the solutions of the 
original quartic are given by x = y — where y is a solution of: 



u 



2.3.4 QUARTIC CURVES 

Any quartic curve of the form y 2 = (x — a) (x — /3) (x — 7) (x — 6) can be written as 
V \ 2 - ( X _ L^L) (l _ (l _ S -^] (2.3.6) 



(x — a) 2 



x — a 



and hence it is cubic in the coordinates X = and Y = x _ a i ■ For example, 
y 2 = 1 -x 4 is the cubic Y 2 = AX 3 -6X 2 +4X-1 in the coordinates X = l/(l-x) 
andY = y/(l-x) 2 . 



2.3.5 QUINTIC POLYNOMIALS 

Some quintic equations are solvable by radicals. If the function f(x) = x 5 + ax + b 
(with a and b rational) is irreducible, then f(x) = is solvable by radicals if, and 
only if, numbers e, c, and e exist (with e = ±1, c > 0, and e ^ 0) such that 

5e 4 (3-4 £C ) -4e 5 (ll e + 2c) 

a = 5— and b = r — . (2.3.7) 

c l + 1 c l + 1 

In this case, the roots are given by x = e (lo^u\ + w 2j it2 + w 3j M3 + lo^ua) for 
j = 0, 1, 2, 3, 4, where cj is a fth root of unity (cj = exp (27ri/5)) and 

(v\v z \ f v 2 vA (vlvA (v\v 2 



Vi 

V3 



d 2 j ' " \ d 2 y J \ D 2 J * v ^ 

Vd + \Jd- t\fD, v 2 = -VD- y/D+eVD, 
-VT) + \/ D + eVD, v 4 = VD - \[d - eVD, and 



£» = c 2 + 1. 
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EXAMPLE The quintic f(x) = x 5 + 15x + 12 has the values e = -1, c = 4/3, and 
e = 1 . Hence the unique real root is given by 

/-75 + 21 % /l0\ 1/6 /-75-21%/lO\ 1/B 
X = { 125 ) + { 125 ) 

^ 225 + 72^ ^ 1/5 / 225 - 72 % /lO \ 1/B 
+ \ 125 J + V 125 J ' 

2.3.6 TSCHIRNHAUS' TRANSFORMATION 

The n th degree polynomial equation 

a„a;™ + a n -\x n ~ x H haia: + ao=0 (2.3.8) 

can be transformed to one with up to three fewer terms, 

z n + bn-iz"- 4 + ■ ■ ■ + foi z + b = (2.3.9) 
by making a transformation of the form 

Zj = j 4 x 4 + j 3 x 3 j + j2X 2 j + 71 Xj + 70 (2.3.10) 

forj = 1, . . . ,n where the {7,}can be computed, in terms ofradicals, from the{a,}. 
Hence, a general quintic polynomial can be transformed to the form z 5 + az + b = 0. 



2.3.7 POLYNOMIAL NORMS 

n 

The polynomial P(x) = ^ ajx-' has the norms: 



i-2-k 



n = I \p(e iS )\Z l^li = X> 

7 2 >(e^) 



(2.3.11) 



1^112 =( / \P(e w )\ l^h = I > >j| I • (2-3.12) 



,2 ^ V2 




HPlloo =max|P(z)| |P|oo =max|a i |. (2.3.13) 

|z| = l 3 

For the double bar norms, P is considered as a function on the unit circle; for the 
single bar norms, P is identi ed with its coef cients. These norms are comparable: 

\P\oc < llPlli < \P\2 = \\P\\2 < \\P\\oc < \P\i < nlPU. (2.3.14) 



2.3.8 CYCLOTOMIC POLYNOMIALS 

The d th cyclotomic polynomial, $d(x), is 

d 

*d(x) = J] {x-Z k )=x*W + ... (2.3.15) 

A=l,2,... 
(k,d) = l 
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where the ^ = e ll,lk l d are the primitive d th roots of unity 



p-i 



x p - 1 
x - 1 



$ p (x) 



if p is prime 



x n - 1 



(2.3.16) 



d\n 



x n + 1 




Ud\n ®d(x) 



d | m 



where n = 2* *m and m is odd. 



n cyclotomic polynomial of degree n 



1 -1 + x 

2 1 + x 

3 1 + x + x 2 = ^Et 

4 1 + x 2 

5 1 + x + x 2 + x 3 + x 4 = ^Et 

6 1 - x + x 2 

7 1 + x + x 2 + x 3 + x 4 + x 5 + x 6 = 2-=r 

a; — 1 

8 1 + x 4 

9 1 + x 3 + x 6 

10 1 - x + x 2 - x 3 + x 4 

11 1 + X + x 2 + X 3 + x 4 + X 5 + X 6 + X 7 + X 8 + X 9 + x 10 = 

12 l-x 2 +x 4 



iJ x-1 

14 1 - x + x 2 - x 3 + x 4 - x 5 + x 6 

15 1 - x + x 3 - x 4 + x 5 - x 7 + x 8 

16 1 + x 8 



£ — 1 

18 l-x 3 +x ( 



" Z-l 

20 1 - x 2 + x 4 - x 6 + x 8 

21 1 -x + x 3 -x 4 +x 6 -x 8 +x 9 -x 11 +x 12 

22 1 - x + x 2 - x 3 + x 4 - x 5 + x 6 - x 7 + x 8 - x 9 + x 



£—1 

24 1 - x 4 + x 8 

25 1 + x 5 + x 10 + x 15 + x 20 

26 1 - x + x 2 - x 3 + x 4 - x 5 + x 6 - x 7 + x 8 - x 9 + x 10 - x 11 + x 

27 l + x 9 +x 18 

28 1 -x 2 +x 4 -x 6 +x 8 -x 10 +x 12 



^ J x-1 

30 1 + x - x 3 - x 4 - x 5 + x 7 + x' 
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2.3.9 OTHER POLYNOMIAL PROPERTIES 

n 

1. Jensen's inequality: For the polynomial P(x) = ^ a,-x J ', with a 



r 2TT 



r do 

j o log|P(e ifl )| — >log|oo|. (2.3.17) 
2. Symmetric form: The polynomial P(xi, . . . , x n ) = ^ ciaX® 1 x" 2 ■ ■ ■ x% N , 

\a\—m 

where a = (a.\ , . . . , ajy) can be written in the symmetric form 

JV 

P{x\, . . . , Xn) — ^ ^ C-ii ,...,i rn Xi 1 Xi 2 ■ ■ ■ Xi m (2.3. 18) 

i\ — 1 



with Cj, , = ^tt; — 2—3- — . This means that the X1X2 term is written as 

^(0:1X2 + £2^1), the term a^a^ becomes ^{xixixi + xiX\Xi + xiXiX\). 

3. The Mahler measure (a valuation) of the polynomial P (x) = a n x n +a n -\x n ~ 1 
H h cio = a„(x - zi)(x - ^2) ■ ■ ■ (x - z„) is given by 

M(P) = \a n \ f[ max(l, \ Zi \) = exp ^ jf log |P (e 2jr «) | tft 

This valuation satis es the properties: 

(a) M(P)M(Q) = M(PQ) 

(b) M(P(x)) = M(P(x k )) fork > 1 

(c) M^P^" 1 )) = M(P(x)) 



2.4 NUMBER THEORY 



2.4.1 DIVISIBILITY 

The notation "a\b" means that the number a evenly divides the number b. That is, 
the ratio £ is an integer. 
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2.4.2 CONGRUENCES 



1 . If the integers a and b leave the same remainder when divided by the number 
n, then a and b are congruent modulo n. This is written a = b (mod n). 

2. If the congruence x 2 = a (mod p) has a solution, then a is a quadratic residue 
of p. Otherwise, a is a quadratic non-residue of p. 

(a) Let p be an odd prime. Legendre's symbol ^ j has the value +1 if a is 
a quadratic residue of p, and the value —1 if a is a quadratic non-residue 
of p. This can be written = a( p ~ 1 )< / ' 2 (mod p). 

(b) The Jacobi symbol generalizes the Legendre symbol to non-prime mod- 
uli. If n = njLi Pi' men me J ac °bi symbol can be written in terms of 
the Legendre symbol as follows 



;)=g(s) 



(2.4.1) 



3. An exact covering sequence is a set of non-negative ordered pairs {(a j, 

such that every non-negative integer n satis es n = a, (mod 6,) for exactly 
one i. An exact covering sequence satis es 



1 



— . (2.4.2) 



For example, every positive integer n is either congruent to 1 mod 2, or 
mod 4, or 2 mod 4. Hence, the three pairs {(1,2), (0,4), (2,4)} of residues 
and moduli exactly cover the positive integers. Note that 

+ T J -Z + ^ZZ~. (2-4.3) 



l-x 2 l-x A l-x A l-x 



4. Carmichael numbers are composite numbers n that satisfy a™ -1 = 1 (mod n) 
for every a (with 1 < a < n) that is relatively prime to n. There are in nitely 
many Carmichael numbers. Every Carmichael number has at least three prime 
factors. If n = J\ t Pi is a Carmichael number, then (p, — 1) divides (n — 1) 
for each i. 

There are 43 Carmichael numbers less than 10 6 and 105,212 less than 10 15 . 
The Carmichael numbers less than ten thousand are 561, 1105, 1729, 2465, 
2821,6601, and 8911. 
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2.4.2.1 Properties of congruences 

1. If a = 6 (mod n), then 6 = a (mod n). 

2. If a = b (mod n), and b = c (mod n), then a = c (mod n). 

3. If a = a' (mod n), and 6 = 6' (mod n), then a±b = a' ±6' (mod n). 

4. If a = a' (mod n), then a 2 = (a') 2 (mod n), a 3 = (a') 3 (mod n), etc. 

5. If GCD(A;,to) = d, then the congruence kx = n (mod to) is solvable if and 
only if d divides n. It then has d solutions. 

6. If p is a prime, then aP = a (mod p) . 

7. If p is a prime, and p does not divide a, then a p_1 = 1 (mod p). 

8. IfGCD(a,m) = lthena^ (m) = 1 (mod to). (See Section 2.4.15 for ^(to).) 

9. If p is an odd prime and a is not a multiple of p, then Wilson's theorem states 
(p - 1)1 = - (|) a^" 1 )/ 2 (mod p). 

10. If p and g are odd primes, then Gauss's law of quadratic reciprocity states that 
I - ] [ — I = (— 1)(p _1 )(9- 1 )/ 4 Therefore, if a and 6 are relatively prime odd 

integers and 6 > 3, then = (-l)^" 1 )^- 1 )/ 4 Q j . 

11. The number —1 is a quadratic residue of primes of the form 4k + 1 and a 
non-residue of primes of the form 4k + 3. That is 

/ -1\ = ( _ 1)(p -i)/2 = f + 1 when P = 1 (mod 4) 
\ p J 1-1 whenp = 3 (mod 4) 

12. The number 2 is a quadratic residue of primes of the form 8k ± 1 and a non- 
residue of primes of the form 8k ± 3. That is 

l\ = (_i)(p 2 -i)/8 - J + 1 when P = ±! ( mod 8 ) 
p) y-l whenp=±3 (mod 8) 

13. The number —3 is a quadratic residue of primes of the form 6k + 1 and a 
non-residue of primes of the form 6k + 5. 

14. The number 3 is a quadratic residue of primes of the form 12A: ± 1 and a 
non-residue of primes of the form 12A: ± 5. 
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2.4.3 CHINESE REMAINDER THEOREM 



Let mi,iri2, ■ ■ ■ ,m r be pairwise relatively prime integers. Then the system of 
congruences 

x = a\ (mod m\) 
x = ci2 (mod TO2) 

(2.4.4) 

x = a r (mod m r ) 

has a unique solution modulo M = mim^- ■ -m r . This unique solution can be 
written as 

x = aiM x y x + a 2 M 2 y 2 H h a r M r y r (2.4.5) 

where = M/nik, and y^ is the inverse of Mj. (modulo nik)- 
EXAMPLE For the system of congruences 

x = 1 (mod 3) 
x = 2 (mod 5) 
x = 3 (mod 7) 

we have M = 3 • 5 • 7 = 105. Hence Mi = 35, M 2 = 21, and M 3 = 15. The equation 
for yi is M\y\ = 35yi = 1 (mod 3) with solution yi = 2 (mod 3). Likewise, y 2 = 
1 (mod 5) and y 3 = 1 (mod 7). This results in a; = 1-35-2 + 2-211 + 3151 = 52 
(mod 105). 



2.4.4 CONTINUED FRACTIONS 

The symbol [do, cti, ■ ■ ■ , ajv], with a, > 0, represents the simple continued fraction, 

[a ,ai,...,a N ] = a H (2.4.6) 

ai H 

02 H 

a 3 H 

a 4 H — 

1 . 

a N 

Then" 1 convergent (with < n < AT) of [ao, ai, • • • , ajv] is de ned to be [ao, ai, ■ ■ ■ , a„]. 
If and {g„} are de ne d by 

PO = AO, Pi = dido + 1, Pn = a n Pn-\ + Pn-2 (2 < 71 < N) 

5o = l, qi=a 1 , q n = a n q n -i + q n - 2 (2<n<N) 

then [ao, a\ , . . . , a n ] = p n /q n - The continued fraction is convergent if and only if 
the in nite series a, is divergent. 
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If the positive rational number x can be represented by a simple continued frac- 
tion with an odd (even) number of terms, then it is also representable by one with 
an even (odd) number of terms. (Speci cally , if a n = 1 then [do, . . . , a„_i, 1] = 
[ao, • • • , a„_i + 1], and if a n > 2, then [do, ■ ■ ■ ,a n ] = [do, . . . ,a n — 1, 1].) Aside 
from this indeterminacy, the simple continued fraction of x is unique. The error in 
approximating by a convergent is bounded by 



Pn 

q n 



< 



1 



1 



< — • 

q n q n +i q„ 



(2.4.7) 



The algorithm for ndin g a continued fraction expansion of a number is to re- 
move the integer part of the number (this becomes a take the reciprocal, and repeat. 
For example, for the number tt: 



0o = tt « 3.14159 
Pi = l/GSo - ao) m 7.062 
fa = l/ifa - ai) ps 15.997 
Pz = l/(/?2 - a 2 ) ps 1.0034 
Pi = l/(0 3 - a 3 ) ps 292.6 



ao = [Po\ = 3 

ai = LA J = 7 

a 2 = L/? 2 J = 15 

a 3 = L/?sJ = 1 

a 4 = L/? 4 J = 292 



Approximations to tt and e may be found from tt = [3, 7, 15, 1, 292, 1, 1, 1, 2, 1, 3, 
1, 14, 2, ... ] and e = [2, 1, 2, 1, 1, 4, 1, 1, 6, ... , 1, 1, In,... ]. The convergents for 



tt are f ps 3.142, f§§ ps 3.14150, ^| ps 3.1415929, ps 3.1415926530, . 

The convergents for e are § ps 2.6, ±± ps 2.75, ^ ps 2.714, § ps 2.7187, . 



7 " 106 u.j-tj.^, ^ 3 ~ 3310^ r 

3 ~ ■"■«) 4 ~ ■"■ ' 7 ~ ' ^Zj 32 

A periodic continued fraction is an in nite continued fraction in which a/ = 
ai + k for all I > L. The set of partial quotients a^, a,L+i, ■ ■ ■ , a^+k-i is me period. 
A periodic continued fraction may be written as 



[ao, ai, . . . , ax_i,ax, ax+i, . . . , ol+^-i] 



For example, 

V2 = [l,2] 
>/3 = [1,172] 
>/4=[2] 
v^= [2,4] 



>/6: 

V8 
V9 



[2, 274] 

[2,T7T7T^ 

[2,174] 

[3] 



V^IO : 

1/12 : 
\/l3 : 



[3,6] 

[3,376] 
[3,276] 

[3,1,1,1,1,6] 



l/l5 : 

: 

>/l7: 



(2.4.8) 



[3,T7XT76] 
[3,1,6] 

[4] 

[4,8] 



If a; = [b, a] then a; = \{b+ 
= [272] = 1 + V2, and [27T 



[M] = (l + >/5)/2, 



/6 2 + f ). For example, [T] 

[2] = [272] = 1 + V2, and [2~T] = 1 + V3. 

Functions can be represented as continued fractions. Using the notation 



60 + 



ai 



h + 



a 2 



62 + 



03 



63 + 



04 



64 + 



60 + 



ai ai az 04 
61+ 62+63+^4 + 



(2.4.9) 



we have (allowable values of z may be restricted in the following) 
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(a) ln(l + z) 



z z z 4z 4z 9z 
1+ 2+ 3+ 4+ 5+ 6 + 



(b) e z 



z z z z z 



1- 1+ 2- 3+ 2- 5+ 2- 

(c) tan z = y~ ^- ^- . . . 

(d) tanh* = 



z z z z z z 
2+ 3- 2+ 5- 2+ 7- 



2.4.5 DIOPHANTINE EQUATIONS 

A diophantine equation is one which requires the solutions to come from the set of 
integers. 

1. Apart from the trivial solutions (with x = y = or x = u), the general 
solution to the equation x 3 + y 3 = u 3 + v 3 is given by 

x = A [1 - (a - 3b)(a 2 + 3b 2 )] y = X [(a + 3b)(a 2 + 3b 2 ) - l] 

u = A [(a + 3b) - (a 2 + 3b 2 ) 2 ] v = A [(a 2 + 3b 2 ) 2 - (a - 3b)] 

(2.4.10) 

where {A, a, b} are any rational numbers except that A ^ 0. 

2. A parametric solution to x 4 + y 4 = u 4 + v 4 is given by 

x = a 7 + a 5 b 2 - 2a 3 b 4 + 3a 2 b 5 + ab 6 

y = a 6 b - 3a 5 b 2 - 2a 4 b 3 + a 2 b 5 + b 7 

u = a J + a H 2 - 2a 3 b 4 - 3a 2 b 5 + ab 6 (2 ' 4 ' U) 

v = a 6 b + 3a 5 b 2 - 2a 4 b 3 + a 2 b 5 + b 7 

3. Fermat's last theorem states that there are no integer solutions to x n +y n = z n , 
when n > 2. This was proved by Andrew Wiles in 1995. 

4. Bachet's equation, y 2 = x 3 + k, has no solutions for k equal to any of the 
following: -144, -105, -78, -69, -42, -34, -33, -31, -24, -14, -5, 7, 
11,23,34, 45,58, 70. 

2.4.5.1 Pythagorean triples 

If the positive integers A, B, and C satisfy the relationship A 2 + B 2 = C 2 , then the 
triplet (A, B, C) is a Pythagorean triple. It is possible to construct a right triangle 
with sides of length A and B and a hypotenuse of C . 

There are in nitely many Pythagorean triples. The most general solution to 
A 2 +B 2 =C 2 , with GCD(A, B) = 1 and A even, is given by 

A = 2xy B=x 2 -y 2 C = x 2 + y 2 , (2.4.12) 
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where x and y are relatively prime integers of opposite parity (i.e., one is even and 
the other is odd) with x > y > 0. The following table shows some Pythagorean 
triples with the associated (x, y) values. 



X 


y 


A = 2xy 


B = x' 2 — y' 2 


C = x 2 + y 2 


2 


l 


4 


3 


5 


4 


l 


8 


15 


17 


6 


l 


12 


35 


37 


8 


l 


16 


63 


65 


10 


l 


20 


99 


101 


3 


2 


12 


5 


13 


5 


2 


20 


21 


29 


7 


2 


28 


45 


51 


4 


3 


24 


7 


25 



2.4.5.2 Pell's equation 

Pell's equation is x 2 — dy 2 = 1. The solutions, integral values of (x, y), arise from 
continued fraction convergents of \fd (see page 96). If (x,y) is the least positive 
solution to Pell's equation (with d square-free), then every positive solution (x k,Vk) 
is given by _ 

x k + y k Vd = (x + yVd) k . (2.4.13) 

The following tables contain the least positive solutions to Pell's equation with d 
square-free and d < 100. 



d 


X 


y 


d 


X 


y 


d 


X 


y 


2 


3 


2 


35 


6 


l 


69 


7,775 


936 


3 


2 


1 


37 


73 


12 


70 


251 


30 


5 


9 


4 


38 


37 


6 


71 


3,480 


413 


6 


5 


2 


39 


25 


4 


73 


2,281,249 


267,000 


7 


8 


3 


41 


2,049 


320 


74 


3,699 


430 


10 


19 


6 


42 


13 


2 


77 


351 


40 


11 


10 


3 


43 


3,482 


531 


78 


53 


6 


13 


649 


180 


46 


24,335 


3,588 


79 


80 


9 


14 


15 


4 


47 


48 


7 


82 


163 


18 


15 


4 


1 


51 


50 


7 


83 


82 


9 


17 


33 


8 


53 


66,249 


9,100 


85 


285,769 


30,996 


19 


170 


39 


55 


89 


12 


86 


10,405 


1,122 


21 


55 


12 


57 


151 


20 


87 


28 


3 


22 


197 


42 


58 


19,603 


2,574 


89 


500,001 


53,000 


23 


24 


5 


59 


530 


69 


91 


1,574 


165 


26 


51 


10 


61 


1,766,319,049 


226,153,980 


93 


12,151 


1,260 


29 


9,801 


1,820 


62 


63 


8 


94 


2,143,295 


221,064 


30 


11 


2 


65 


129 


16 


95 


39 


4 


31 


1,520 


273 


66 


65 


8 


97 


62,809,633 


6,377,352 


33 


23 


4 


67 


48,842 


5,967 
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EXAMPLES 

1. The number \/2 has the continued fraction expansion [1, 2, 2, 2, 2, . . . ], with conver- 
gents |, |, y|, II , || , In this case, every second convergent represents a solution: 



2. The least positive solution for d = 11 is (x,y) = (10, 3). Since (10 + 3%/TT) 2 = 
199 + 60VTT, another solution is given by (x2, y-i) = (199, 60). 

2.4.5.3 Waring's problem 

If each positive integer can be expressed as a sum of n k th powers, then there is a 
least value of n for which this is true: this is the number g(k). For all suf ciently 
large numbers, however, a smaller value of n may suf ce: this is the number G(k). 
Waring's problem is to determine g(n) and G(n). 

1 . Lagrange 's theorem states: "Every positive integer is the sum of four squares"; 
this is equivalent to the statement g(2) = 4. The following identity shows how 
a product can be written as the sum of four squares: 



2. Consider k = 3; all numbers can be written as the sum of not more than 9 
cubes, so that g(3) = 9. However, only the two numbers 



3 2 - 2 • 2 2 
17 2 - 2 • 12 2 
99 2 - 2 • 70 2 



1 



1, and 



1. 




23 = 2 3 + 2 3 + l 3 + l 3 + l 3 + l 3 + l 3 + l 3 + l 3 , 
239 = 4 3 + 4 3 + 3 3 + 3 3 + 3 3 + 3 3 + l 3 + l 3 + l 3 , 



require the use of 9 cubes; so G(3) < 8. 



3. G(k) < 6fclogfc + (4 + 31og(3 + §)) k + 3. 



5(2) = 4 
<?(3) = 9 
g(A) = 19 
9(5) = 37 



6 < G(5) < 18 
9 < G(6) < 27 
8 < G(7) < 36 
32 < G(8) < 42 
13 < G(9) < 82 
12 < G(10) < 102 



4 < G(3) < 7 
G(4) = 16 



G(2) = 4 



4. Known values include g(6) = 73 

143 < g(7) < 306 
279 < g(8) < 36,119 



548 < g(9) 
1,079 < ff(10) 
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2.4.6 GREATEST COMMON DIVISOR 



The greatest common divisor of the integers n and to is the largest integer that evenly 
divides both n and to; this is written as GCD(n, to) or (n, to). The Euclidean algo- 
rithm is frequently used for computing the GCD of two numbers; it utilizes the fact 
that to = |_^J n + p where < p < n. 

Given the integers to and n, two integers a and b can always be found so that 
am + bn = GCD(n, to). 

Two numbers, to and n, are said to be relatively prime if they have no divisors in 
common; i.e., if GCD(a, b) = 1. The probability that two integers chosen randomly 
are relatively prime is tt/6. 

EXAMPLE Consider 78 and 21. Since 78 = 3 • 21 + 15, the largest integer that evenly 
divides both 78 and 21 is also the largest integer that evenly divides both 21 and 15. 
Iterating results in: 

78 = 3 • 21 + 15 
21 = 1 ■ 15 + 6 
15 = 2-6 + 3 
6 = 2-3 + 

Hence GCD(78, 21) = GCD(21, 15) = GCD(15, 6) = GCD(6, 3) = 3. Note that 
78 • (-4) +21 • 15 = 3. 



2.4.7 LEAST COMMON MULTIPLE 

The least common multiple of the integers a and b (denoted LCM(a, b)) is the small- 
est integer r that is divisible by both a and b. The simplest way to nd the LCM of a 

and b is via the formula LCM(a, b) = ab/GCD(a, b). For example, LCM(10, 4) = 
io-4 _ io-4 on 

GCD(10,4) ~~ 2 — 



2.4.8 MAGIC SQUARES 



A magic square is a square array of integers with the property that the sum of the 
integers in each row or column is the same. If (c, n) = (d, n) = (e,n) = (/, n) = 
(cf — en, n) = 1, then the array A = (fly) will be magic (and use the n 2 numbers 



0, 1, 



1) if en 



k with 



i = ck + e 



(mod n) and j = dk + / 



(mod n) 



For example, with c=l,d = e = / = 2, and n = 3, a magic square is 



6 


1 


5 


2 


3 


7 


4 


8 
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2.4.9 MOBIUS FUNCTION 

The Mobius function is de ned by 

1. = 1 2. fj,(n) = if n has a squared factor 

3. /^(pipa ■ ■ -Pit) = (— 1)* if all the primes {pi, . . . ,pju} are distinct 
Its properties include: 

1. If GCD(m,n) = 1 then /j,(mn) = fi(m) fjt(n) 



2. J2»(d) 

d | n 



1 ifn = l 
ifn>l 



3. Generating function: > /i(n)n~ s = —— 
^ C(s) 



n=0 



The Mobius inversion formula states that, if g(n) = f(d), then 



(2.4.15) 



d\n 

For example, the Mobius inversion of n = <j>{d) is ^(n) = n 

rf|n rf|n 

The table below can be derived from the table in Section 2.4.13. The value of 
/x(10n + k) is in row n_ and column _fc. 

Mobius function values 
(For example, /x(2) = —1, /x(4) = 0, and yu(6) = 1.) 





_0 _1 


.2 _3 


.4 


_5 


.6 _7 


.8 


_9 


0. 




-1 -1 





-1 


1 -1 








1. 


1 -1 


-1 


1 


1 


-1 







2. 


1 


1 -1 








1 







3. 


-1 -1 


1 


1 


1 


-1 


1 




4. 


-1 


-1 -1 








1 -1 







5. 


1 


-1 





1 


1 


1 




6. 


-1 


1 





1 


-1 -1 







7_ 


-1 -1 


-1 


1 





1 


-1 




8. 





1 -1 





1 


1 1 







9. 


1 


1 


1 


1 


-1 







10_ 


-1 


-1 -1 





-1 


1 -1 







11_ 


-1 1 


-1 


-1 


1 





1 
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2.4.10 PRIME NUMBERS 



1. A prime number is a positive integer greater than 1 with no positive, inte- 
gral divisors other than 1 and itself. There are in nitely many prime num- 
bers, 2,3,5,7,.... The sum of the reciprocals of the prime numbers diverges: 

2. Twin primes are prime numbers that differ by two: (3,5), (5,7), (11,13), 
(17, 19), ... . It is not known whether there are in nitely many twin primes. 
The sum of the reciprocals of the twin primes converges; the value 

b =G + + G4) + (^ + s) + 

known as Bran's constant is approximately B ?s 1.90216054. 

3. For every integer n > 2, the numbers {n\ + 2, n! + 3, . . . , nl + n} are a 
sequence of n — 1 consecutive composite (i.e., not prime) numbers. 

4. Dirichlet's theorem on primes in arithmetic progressions: Let a and b be rel- 
atively prime positive integers. Then the arithmetic progression an + b (for 
n = 1, 2, . . . ) contains in nitely many primes. 

5. Goldbach conjecture: every even number is the sum of two prime numbers. 

6. The function tt(x) represents the number of primes less than x. The prime 
number theorem states that tt(x) ~ x/ log x as x — > oo. The exact number of 
primes less than a given number is: 



X 


100 


1000 


10,000 


10 5 


10 6 


10 7 


10 8 


ir(x) 


25 


168 


1,229 


9,592 


78,498 


664,579 


5,761,455 



X 


10 10 


10 15 10 21 


tt(x) 


455,052,511 


29,844,570,422,669 21,127,269,486,018,731,928 



2.4.10.1 Prime formulae 

The polynomial x 2 — x + 41 yields prime numbers when evaluated at x = 0, 1, 2, 
...,39. 

The set of prime numbers is identical with the set of positive values taken on by 
the polynomial of degree 25 in the 26 variables {a,b, . . . , z}: 

(k + 2){l-[wz + h + j-q] 2 -[(gk + 2g + k + l)(h + j) + h-z] 2 -[2n+p + q + z-e] 2 
-[16(A: + l) 3 (/ 1 : + 2)(n+l) 2 + l-/ 2 ] 2 -[e 3 (e + 2)(a + l) 2 + l-o 2 ] 2 -[(a 2 -l)y 2 + l- a; 2 ] 2 
-[16ry(a 2 -l)+l-M 2 ] 2 -[((a+M 2 (M 2 -a^ 

-[(a 2 -l)f +l-m 2 ] 2 -[ai+k+l-l-if -\p+l(a-n-l)+b(2an+2a-n 2 -2n-2)-m] 2 

— [q+y(a—p—l)+s(2ap+2a—p 2 — 2p—2)—x] 2 — [z+pl(a—p)+t(2ap—p 2 — l)—pm] 2 }. 

(2.4.16) 
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Although this polynomial appears to factor, the factors are improper, P = P-l. Note 
that this formula will also take on negative values, such as — 76. There also exists 
a prime representing polynomial with 12 variables of degree 13697, and one of 10 
variables and degree about 10 45 . 

2.4.10.2 Lucas-Lehmer primality test 

De ne the sequence r m+ i = — 2 with n = 3. If p is a prime of the form An + 3 
and M p = 2 P — 1, then M p will be prime (called a Mersenne prime) if, and only if, 
M p divides r p -\. 

This simple test is the reason that the largest known prime numbers are Mersenne 
primes. For example, consider p = 7 and M 7 = 127. The {r„} sequence is {3, 7, 
47, 2207 = 48, 2302 = 16, 254 = 0}; hence M 7 is prime. 

2.4.10.3 Primality test certi cates 

A primality certi cate is an easily veri ab le statement (easier than it was to deter- 
mine that it was prime in the rst place) that proves that a speci c number is prime. 
There are several types of certi cates that can be given. The Atkin-Morain certi cate 
uses elliptic curves. 

To prove that the number p is prime, Pratt's certi cate consists of a number a 
and the factorization of the number p—1. The number p will be prime if there exists 
a primitive root a in the eld GF[p] . This primitive root must satisfy the conditions 
a p_1 = 1 (mod p) and a( p_1 )/ g ^ 1 (mod p) for any prime q that divides p — 1. 

EXAMPLE The number p = 31 has p — 1 = 30 = 2 - 3 -5, and a primitive root is given 
by a = 3. Hence, to verify thatp = 31 is prime, we compute 



2.4.10.4 Probabilistic primality test 

Let n be a number whose primality is to be determined. Probabilistic primality tests 
can return one of two results: either a proof that the number n is composite or a 
statement of the form, "The probability that the number n is not prime is less than 
e", where e can be speci ed by the user. Typically, we take e = 2 -20 ° < 10 -60 . 

^From Fermat's theorem, if 6 ^ 0, then b n ~ l = 1 (mod n) whenever n is 
prime. If this holds, then n is a probable prime to the base b. Given a value of n, if 
a value of b can be found such that this does not hold, then n cannot be prime. It can 
happen, however, that a probable prime is not prime. 

Let P(x) be the probability that n is composite under the hypotheses: 

1 . n is an odd integer chosen randomly from the range [2, x] ; 

2. b is an integer chosen randomly from the range [2, n — 2]; 

3. n is a probable prime to the base b. 



3 (31-l)/2 
g(31-l)/3 
o(31-l)/5 



: 14348907 = -1 ^1 
: 59049 = 25 ^ 1 
729 = 16 ^ 1 



(mod 31) 
(mod 31) 
(mod 31) 




(mod 31). 
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ThenP(a;) < (log a;)" 197 for a; > 10 10000 . 

A different test can be obtained from the following theorem. Given the number 
n, nd s and t with n — 1 = 2 s t, with t odd. Then choose a random integer b from 
the range [2, n — 2]. If either 

b l = 1 (mod n) or b 2 1 = — 1 (mod n), for some i < s, 

then n is a strong probable prime to the base b. Every odd prime must pass this test. 
If n > 1 is an odd composite, then the probability that it is a strong probable prime 
to the base b, when b is chosen randomly, is less than 1/4. 

A stronger test can be obtained by choosing k independent values for b in the 
range [2,n — 2] and checking the above relation for each value of b. Let Pk(x) be 
the probability that n is found to be a strong probable prime to each base b. Then 
P*(x) < 4-(*- 1 )P(x)/(1 -P(x)). 



2.4.1 1 PRIME NUMBERS OF SPECIAL FORMS 

1 . The largest known prime numbers, in descending order, are 



Prime number 


Number of digits 


213466917 




1 


4,053,946 


26972593 




1 


2,098,960 


23021377 




1 


909,526 


22976221 




1 


895,932 


21398269 




1 


420,921 


1266062 65536 


+ 


1 


399,931 


5 . 21320487 


+ 


1 


397,507 


857678 65536 


+ 


1 


388,847 


843832 65536 


+ 


1 


388,384 


5 . 21282755 


+ 


1 


386,149 



2. The largest known twin primes are: 318032361 • 2 107001 ± 1 (with 32,220 
digits), 1807318575-2 98305 ±1 (with 29,603 digits), and 665551035-2 80025 ±1 
(with 24,099 digits). 

3. There exist constants 6 ?s 1.30637788 and to w 1.9287800 such that |# 3 "J 
and are prime for every n > 1. 

n 

4. Primes with special properties 

(a) A Sophie Germain prime p has the property that 2p + 1 is also prime. 
Sophie Germain primes include: 2, 3, 5, 11, 23, 29, 41, 53, 83, 89, 
113, 131, 3714089895285 • 2 60000 - 1, 984798015 • 2 66444 - 1, 
109433307 • 2 66452 - 1, .... 
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(b) An odd prime p is called a Wieferich prime if 2 P 1 = 1 (mod p 2 ). 
Wieferich primes include 1093 and 3511. 

(c) A Wilson prime satis es (p — 1)! = —1 (mod p 2 ). Wilson primes in- 
clude 5, 13, and 563. 

5. For each n shown below, the numbers {a + md \ m = 0, 1, . . . , n — 1} are an 
arithmetic sequence of n prime numbers: 



n a a + (n — l)d d 

~3 3 7 2 

4 61 79 6 

5 11 131 30 
10 199 2089 210 



22 11410337850553 108201410428753 4609098694200 



6. De ne p# to be the product of the prime numbers less than or equal to p. 



Form 


Values of n or p for which the form is prime 


2 2 " -1- 1 


\J , 1 , Z,, J, t . . . V^l ClllltlL uiiiiic&y 


2 n - 1 


2, 3, 5, 7, 13, 17, 19, 31, 61, 89, 107, 127, 521, 607, 1279, 
2203, 2281, 3217, 4253, 4423, 9689, 9941, 11213, 19937, 
21701, 23209, 44497, 86243, 110503, 132049, 216091, 
756839, 859433, 1257787, 1398269, 2976221, 3021377, 
6972593, . . . , 13466917 . . . (Mersenne primes) 


n\ - 1 


3, 4, 6, 7, 12, 14, 30, 32, 33, 38, 94, 166, 324, 379, 469, 
546, 974, 1963, 3507, 3610, 6917, . . . 

(factorial primes) 


n\ + 1 


1, 2, 3, 1 1, 27, 37, 41, 73, 77, 1 16, 154, 320, 340, 399, 427, 
872, 1477, 6380, . . . (factorial primes) 




3, 5, 11, 13, 41, 89, 317, 337, 991, 1873, 2053, 2377, 4093, 
4297, 4583, 6569, 13033, 15877, . . . 

(primorial primes) 




2,3,5,7, 11,31,379, 1019, 1021,2657,3229, 4547,4787, 
11549, 13649, 18523, 23801, 24029, 42209, 145823, 
366439, 3921 13, . . . (primorial primes) 


n2 n + 1 


1, 141, 4713, 5795, 6611, 18496, 32292, 32469, 59656, 
90825, 262419, 361275, . . . , 481899, . . . 

(Cullen primes) 


n2 n - 1 


2, 3, 6, 30, 75, 81, 115, 123, 249, 362, 384, 462, 512, 751, 
822, 5312, 7755, 9531, 12379, 15822, 18885, ...143018, 
151023, 667071, . . . (Woodall primes) 
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7. Prime numbers of the form (called repunits). 

a — 1 



Form 


Values of n for which the form is prime 


2™ - 1 
1 


These are Mersenne primes; see the previous table. 


3™ - 1 
2 


3, 7, 13, 71, 103, 541, 1091, 1367, 1627, 4177, 9011, 9551, . . . 


5™ - 1 
4 


3,7, 11, 13,47, 127, 149, 181,619, 929, 3407, 10949, ... 


6™ - 1 
5 


2, 3, 7, 29, 71, 127, 271, 509, 1049, 6389, 6883, 10613, . . . 


7™ - 1 
6 


5, 13, 131, 149, 1699, ... 


10™ - 1 
9 


2, 19, 23, 317, 1031, 49081, 86453, . . . 


ll n - 1 
10 


17, 19, 73, 139, 907, 1907, 2029, 4801, 5153, 10867, . . . 


12™ - 1 
11 


2, 3, 5, 19, 97, 109, 317, 353, 701, 9739, . . . 



8. Prime numbers of the forms 2" ± a, 10" ± b, and 16" ± c. 

In the following table, for a given value of n, the quantities a±, b±, and c± 
are the least values such that 2" + a±, 10™ + 6±, and 16" + c± are probably 
primes. (A probabilistic primality test was used.) For example, for n = 3, 
the numbers 2 3 - 1 = 7, 2 3 + 3 = 11, 10 3 - 3 = 997, 10 3 + 9 = 1009, 
16 3 - 3 = 4093, and 16 3 + 3 = 4099 are all prime. 





2™ 


+ a 


10™ 


+ b 


16" 


+ c 


n 


a_ 


a+ 


b- 


h 


c_ 


c+ 


2 


-1 


1 


-3 


1 


-5 


1 


3 


-1 


3 


-3 


9 


-3 


3 


4 


-3 


1 


-27 


7 


-15 


1 


5 


-1 


5 


-9 


3 


-3 


7 


6 


-3 


3 


-17 


3 


-3 


43 


7 


-1 


3 


-9 


19 


-57 


3 


8 


-5 


1 


-11 


7 


-5 


15 


9 


-3 


9 


-63 


7 


-5 


31 


10 


-3 


7 


-33 


19 


-87 


15 


11 


-9 


5 


-23 


3 


-17 


7 


12 


-3 


3 


-11 


39 


-59 


21 


13 


-1 


17 


-29 


37 


-47 


21 


14 


-3 


27 


-27 


31 


-5 


81 
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2™ +a 


10™ + 6 


16" 


+ c 


n 


CI — 


a + 


U — 




c_ c+ 


15 


-19 


3 


-11 


37 


—93 


33 


16 


— 10 


i 
i 


— 00 


1 


— 59 


1 3 


17 


-1 


29 


-3 


3 


-23 


33 


18 


-5 


3 


-11 


3 


-93 


15 


19 


-1 


21 


-39 


51 


-15 


15 


20 


-3 


7 


-11 


39 


—65 


13 


50 


97 




^7 


i j i 


— 75 


235 


100 


-15 


277 


-797 


267 


-593 


181 


150 


-3 


147 


-273 


67 


-95 


187 


200 


-75 


235 


-189 


357 


-105 


25 


300 


-153 


157 


-69 


331 


-305 


1515 


400 


-593 


181 


-513 


69 


-2273 


895 


500 


-863 


55 


-1037 


961 


-2217 


841 


600 


-95 


187 


-1791 


543 


-5 


255 


700 


-1113 


535 


-2313 


7 


-909 


2823 


800 


-105 


25 


-1007 


1537 


-1683 


751 


900 


-207 


693 


-773 


1873 


-1193 


8767 


1000 


-1245 


297 


-1769 


453 


-2303 


63 



2.4.12 PRIME NUMBERS LESS THAN 100,000 

The prime number pio n +k is found by looking at row n _ and the column _fc. 





.0 


.1 


.2 


_3 


.4 


J, 


.6 


.7 


.8 


.9 


0. 




2 


3 


5 


7 


11 


13 


17 


19 


23 


1. 


29 


31 


37 


41 


43 


47 


53 


59 


61 


67 


2. 


71 


73 


79 


83 


89 


97 


101 


103 


107 


109 


3. 


113 


127 


131 


137 


139 


149 


151 


157 


163 


167 


4. 


173 


179 


181 


191 


193 


197 


199 


211 


223 


227 


5. 


229 


233 


239 


241 


251 


257 


263 


269 


271 


277 


6. 


281 


283 


293 


307 


311 


313 


317 


331 


337 


347 


7. 


349 


353 


359 


367 


373 


379 


383 


389 


397 


401 


8. 


409 


419 


421 


431 


433 


439 


443 


449 


457 


461 


9. 


463 


467 


479 


487 


491 


499 


503 


509 


521 


523 


10. 


541 


547 


557 


563 


569 


571 


577 


587 


593 


599 


11. 


601 


607 


613 


617 


619 


631 


641 


643 


647 


653 


12. 


659 


661 


673 


677 


683 


691 


701 


709 


719 


727 


13. 


733 


739 


743 


751 


757 


761 


769 


773 


787 


797 


14. 


809 


811 


821 


823 


827 


829 


839 


853 


857 


859 


15. 


863 


877 


881 


883 


887 


907 


911 


919 


929 


937 


16. 


941 


947 


953 


967 


971 


977 


983 


991 


997 


1009 


17. 


1013 


1019 


1021 


1031 


1033 


1039 


1049 


1051 


1061 


1063 


18. 


1069 


1087 


1091 


1093 


1097 


1103 


1109 


1117 


1123 


1129 


19. 


1151 


1153 


1163 


1171 


1181 


1187 


1193 


1201 


1213 


1217 


20. 


1223 


1229 


1231 


1237 


1249 


1259 


1277 


1279 


1283 


1289 


21. 


1291 


1297 


1301 


1303 


1307 


1319 


1321 


1327 


1361 


1367 


22. 


1373 


1381 


1399 


1409 


1423 


1427 


1429 


1433 


1439 


1447 
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.0 


.1 


.2 


J 


.4 


.5 


.6 


.7 


.8 


.9 


23. 


1451 


1453 


1459 


1471 


1481 


1483 


1487 


1489 


1493 


1499 


24. 


1511 


1523 


1531 


1543 


1549 


1553 


1559 


1567 


1571 


1579 


25. 


1583 


1597 


1601 


1607 


1609 


1613 


1619 


1621 


1627 


1637 


26. 


1657 


1663 


1667 


1669 


1693 


1697 


1699 


1709 


1721 


1723 


27. 


1733 


1741 


1747 


1753 


1759 


1777 


1783 


1787 


1789 


1801 


28. 


1811 


1823 


1831 


1847 


1861 


1867 


1871 


1873 


1877 


1879 


29. 


1889 


1901 


1907 


1913 


1931 


1933 


1949 


1951 


1973 


1979 


30. 


1987 


1993 


1997 


1999 


2003 


2011 


2017 


2027 


2029 


2039 


31. 


2053 


2063 


2069 


2081 


2083 


2087 


2089 


2099 


2111 


2113 


32. 


2129 


2131 


2137 


2141 


2143 


2153 


2161 


2179 


2203 


2207 


33. 


2213 


2221 


2237 


2239 


2243 


2251 


2267 


2269 


2273 


2281 


34. 


2287 


2293 


2297 


2309 


2311 


2333 


2339 


2341 


2347 


2351 


35. 


2357 


2371 


2377 


2381 


2383 


2389 


2393 


2399 


2411 


2417 


36. 


2423 


2437 


2441 


2447 


2459 


2467 


2473 


2477 


2503 


2521 


37. 


2531 


2539 


2543 


2549 


2551 


2557 


2579 


2591 


2593 


2609 


38. 


2617 


2621 


2633 


2647 


2657 


2659 


2663 


2671 


2677 


2683 


39. 


2687 


2689 


2693 


2699 


2707 


2711 


2713 


2719 


2729 


2731 


40. 


2741 


2749 


2753 


2767 


2777 


2789 


2791 


2797 


2801 


2803 


41. 


2819 


2833 


2837 


2843 


2851 


2857 


2861 


2879 


2887 


2897 


42. 


2903 


2909 


2917 


2927 


2939 


2953 


2957 


2963 


2969 


2971 


43. 


2999 


3001 


3011 


3019 


3023 


3037 


3041 


3049 


3061 


3067 


44. 


3079 


3083 


3089 


3109 


3119 


3121 


3137 


3163 


3167 


3169 


45. 


3181 


3187 


3191 


3203 


3209 


3217 


3221 


3229 


3251 


3253 


46. 


3257 


3259 


3271 


3299 


3301 


3307 


3313 


3319 


3323 


3329 


47. 


3331 


3343 


3347 


3359 


3361 


3371 


3373 


3389 


3391 


3407 


48. 


3413 


3433 


3449 


3457 


3461 


3463 


3467 


3469 


3491 


3499 


49. 


3511 


3517 


3527 


3529 


3533 


3539 


3541 


3547 


3557 


3559 


50. 


3571 


3581 


3583 


3593 


3607 


3613 


3617 


3623 


3631 


3637 


51. 


3643 


3659 


3671 


3673 


3677 


3691 


3697 


3701 


3709 


3719 


52. 


3727 


3733 


3739 


3761 


3767 


3769 


3779 


3793 


3797 


3803 


53. 


3821 


3823 


3833 


3847 


3851 


3853 


3863 


3877 


3881 


3889 


54. 


3907 


3911 


3917 


3919 


3923 


3929 


3931 


3943 


3947 


3967 


55. 


3989 


4001 


4003 


4007 


4013 


4019 


4021 


4027 


4049 


4051 


56. 


4057 


4073 


4079 


4091 


4093 


4099 


4111 


4127 


4129 


4133 


57. 


4139 


4153 


4157 


4159 


4177 


4201 


4211 


4217 


4219 


4229 


58. 


4231 


4241 


4243 


4253 


4259 


4261 


4271 


4273 


4283 


4289 


59. 


4297 


4327 


4337 


4339 


4349 


4357 


4363 


4373 


4391 


4397 


60. 


4409 


4421 


4423 


4441 


4447 


4451 


4457 


4463 


4481 


4483 


61. 


4493 


4507 


4513 


4517 


4519 


4523 


4547 


4549 


4561 


4567 


62. 


4583 


4591 


4597 


4603 


4621 


4637 


4639 


4643 


4649 


4651 


63. 


4657 


4663 


4673 


4679 


4691 


4703 


4721 


4723 


4729 


4733 


64. 


4751 


4759 


4783 


4787 


4789 


4793 


4799 


4801 


4813 


4817 


65. 


4831 


4861 


4871 


4877 


4889 


4903 


4909 


4919 


4931 


4933 


66. 


4937 


4943 


4951 


4957 


4967 


4969 


4973 


4987 


4993 


4999 


67. 


5003 


5009 


5011 


5021 


5023 


5039 


5051 


5059 


5077 


5081 


68. 


5087 


5099 


5101 


5107 


5113 


5119 


5147 


5153 


5167 


5171 


69. 


5179 


5189 


5197 


5209 


5227 


5231 


5233 


5237 


5261 


5273 


70. 


5279 


5281 


5297 


5303 


5309 


5323 


5333 


5347 


5351 


5381 


71. 


5387 


5393 


5399 


5407 


5413 


5417 


5419 


5431 


5437 


5441 


72. 


5443 


5449 


5471 


5477 


5479 


5483 


5501 


5503 


5507 


5519 


73. 


5521 


5527 


5531 


5557 


5563 


5569 


5573 


5581 


5591 


5623 


74. 


5639 


5641 


5647 


5651 


5653 


5657 


5659 


5669 


5683 


5689 


75. 


5693 


5701 


5711 


5717 


5737 


5741 


5743 


5749 


5779 


5783 


76. 


5791 


5801 


5807 


5813 


5821 


5827 


5839 


5843 


5849 


5851 


77. 


5857 


5861 


5867 


5869 


5879 


5881 


5897 


5903 


5923 


5927 


78. 


5939 


5953 


5981 


5987 


6007 


6011 


6029 


6037 


6043 


6047 
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.0 


.1 


.2 


.3 


.4 


J5 


.6 


.7 


.8 


.9 


79. 


6053 


6067 


6073 


6079 


6089 


6091 


6101 


6113 


6121 


6131 


80. 


6133 


6143 


6151 


6163 


6173 


6197 


6199 


6203 


6211 


6217 


81. 


6221 


6229 


6247 


6257 


6263 


6269 


6271 


6277 


6287 


6299 


82. 


6301 


6311 


6317 


6323 


6329 


6337 


6343 


6353 


6359 


6361 


83. 


6367 


6373 


6379 


6389 


6397 


6421 


6427 


6449 


6451 


6469 


84. 


6473 


6481 


6491 


6521 


6529 


6547 


6551 


6553 


6563 


6569 


85. 


6571 


6577 


6581 


6599 


6607 


6619 


6637 


6653 


6659 


6661 


86. 


6673 


6679 


6689 


6691 


6701 


6703 


6709 


6719 


6733 


6737 


87. 


6761 


6763 


6779 


6781 


6791 


6793 


6803 


6823 


6827 


6829 


88. 


6833 


6841 


6857 


6863 


6869 


6871 


6883 


6899 


6907 


6911 


89. 


6917 


6947 


6949 


6959 


6961 


6967 


6971 


6977 


6983 


6991 


90. 


6997 


7001 


7013 


7019 


7027 


7039 


7043 


7057 


7069 


7079 


91. 


7103 


7109 


7121 


7127 


7129 


7151 


7159 


7177 


7187 


7193 


92. 


7207 


7211 


7213 


7219 


7229 


7237 


7243 


7247 


7253 


7283 


93. 


7297 


7307 


7309 


7321 


7331 


7333 


7349 


7351 


7369 


7393 


94. 


7411 


7417 


7433 


7451 


7457 


7459 


7477 


7481 


7487 


7489 


95. 


7499 


7507 


7517 


7523 


7529 


7537 


7541 


7547 


7549 


7559 


96. 


7561 


7573 


7577 


7583 


7589 


7591 


7603 


7607 


7621 


7639 


97. 


7643 


7649 


7669 


7673 


7681 


7687 


7691 


7699 


7703 


7717 


98. 


7723 


7727 


7741 


7753 


7757 


7759 


7789 


7793 


7817 


7823 


99. 


7829 


7841 


7853 


7867 


7873 


7877 


7879 


7883 


7901 


7907 


100. 


7919 


7927 


7933 


7937 


7949 


7951 


7963 


7993 


8009 


8011 


101. 


8017 


8039 


8053 


8059 


8069 


8081 


8087 


8089 


8093 


8101 


102. 


8111 


8117 


8123 


8147 


8161 


8167 


8171 


8179 


8191 


8209 


103. 


8219 


8221 


8231 


8233 


8237 


8243 


8263 


8269 


8273 


8287 


104. 


8291 


8293 


8297 


8311 


8317 


8329 


8353 


8363 


8369 


8377 


105. 


8387 


8389 


8419 


8423 


8429 


8431 


8443 


8447 


8461 


8467 


106. 


8501 


8513 


8521 


8527 


8537 


8539 


8543 


8563 


8573 


8581 


107. 


8597 


8599 


8609 


8623 


8627 


8629 


8641 


8647 


8663 


8669 


108. 


8677 


8681 


8689 


8693 


8699 


8707 


8713 


8719 


8731 


8737 


109. 


8741 


8747 


8753 


8761 


8779 


8783 


8803 


8807 


8819 


8821 


110. 


8831 


8837 


8839 


8849 


8861 


8863 


8867 


8887 


8893 


8923 


111. 


8929 


8933 


8941 


8951 


8963 


8969 


8971 


8999 


9001 


9007 


112. 


9011 


9013 


9029 


9041 


9043 


9049 


9059 


9067 


9091 


9103 


113. 


9109 


9127 


9133 


9137 


9151 


9157 


9161 


9173 


9181 


9187 


114. 


9199 


9203 


9209 


9221 


9227 


9239 


9241 


9257 


9277 


9281 


115. 


9283 


9293 


9311 


9319 


9323 


9337 


9341 


9343 


9349 


9371 


116. 


9377 


9391 


9397 


9403 


9413 


9419 


9421 


9431 


9433 


9437 


117. 


9439 


9461 


9463 


9467 


9473 


9479 


9491 


9497 


9511 


9521 


118. 


9533 


9539 


9547 


9551 


9587 


9601 


9613 


9619 


9623 


9629 


119. 


9631 


9643 


9649 


9661 


9677 


9679 


9689 


9697 


9719 


9721 


120. 


9733 


9739 


9743 


9749 


9767 


9769 


9781 


9787 


9791 


9803 


121. 


9811 


9817 


9829 


9833 


9839 


9851 


9857 


9859 


9871 


9883 


122. 


9887 


9901 


9907 


9923 


9929 


9931 


9941 


9949 


9967 


9973 


123. 


10007 


10009 


10037 


10039 


10061 


10067 


10069 


10079 


10091 


10093 


124. 


10099 


10103 


10111 


10133 


10139 


10141 


10151 


10159 


10163 


10169 


125. 


10177 


10181 


10193 


10211 


10223 


10243 


10247 


10253 


10259 


10267 


126. 


10271 


10273 


10289 


10301 


10303 


10313 


10321 


10331 


10333 


10337 


127. 


10343 


10357 


10369 


10391 


10399 


10427 


10429 


10433 


10453 


10457 


128. 


10459 


10463 


10477 


10487 


10499 


10501 


10513 


10529 


10531 


10559 


129. 


10567 


10589 


10597 


10601 


10607 


10613 


10627 


10631 


10639 


10651 


130. 


10657 


10663 


10667 


10687 


10691 


10709 


10711 


10723 


10729 


10733 


131. 


10739 


10753 


10771 


10781 


10789 


10799 


10831 


10837 


10847 


10853 


132. 


10859 


10861 


10867 


10883 


10889 


10891 


10903 


10909 


10937 


10939 


133. 


10949 


10957 


10973 


10979 


10987 


10993 


11003 


11027 


11047 


11057 


134. 


11059 


11069 


11071 


11083 


11087 


11093 


11113 


11117 


11119 


11131 
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.0 


-1 


.2 


.3 


.4 


J5 


.6 


.7 


.8 


.9 


135. 


11149 


11159 


11161 


11171 


11173 


11177 


11197 


11213 


11239 


11243 


136. 


11251 


11257 


11261 


11273 


11279 


11287 


11299 


11311 


11317 


11321 


137. 


11329 


11351 


11353 


11369 


11383 


11393 


11399 


11411 


11423 


11437 


138. 


11443 


11447 


11467 


11471 


11483 


11489 


11491 


11497 


11503 


11519 


139. 


11527 


11549 


11551 


11579 


11587 


11593 


11597 


11617 


11621 


11633 


140. 


11657 


11677 


11681 


11689 


11699 


11701 


11717 


11719 


11731 


11743 


141. 


11777 


11779 


11783 


11789 


11801 


11807 


11813 


11821 


11827 


11831 


142. 


11833 


11839 


11863 


11867 


11887 


11897 


11903 


11909 


11923 


11927 


143. 


11933 


11939 


11941 


11953 


11959 


11969 


11971 


11981 


11987 


12007 


144. 


12011 


12037 


12041 


12043 


12049 


12071 


12073 


12097 


12101 


12107 


145. 


12109 


12113 


12119 


12143 


12149 


12157 


12161 


12163 


12197 


12203 


146. 


12211 


12227 


12239 


12241 


12251 


12253 


12263 


12269 


12277 


12281 


147. 


12289 


12301 


12323 


12329 


12343 


12347 


12373 


12377 


12379 


12391 


148. 


12401 


12409 


12413 


12421 


12433 


12437 


12451 


12457 


12473 


12479 


149. 


12487 


12491 


12497 


12503 


12511 


12517 


12527 


12539 


12541 


12547 


150. 


12553 


12569 


12577 


12583 


12589 


12601 


12611 


12613 


12619 


12637 


151. 


12641 


12647 


12653 


12659 


12671 


12689 


12697 


12703 


12713 


12721 


152. 


12739 


12743 


12757 


12763 


12781 


12791 


12799 


12809 


12821 


12823 


153. 


12829 


12841 


12853 


12889 


12893 


12899 


12907 


12911 


12917 


12919 


154. 


12923 


12941 


12953 


12959 


12967 


12973 


12979 


12983 


13001 


13003 


155. 


13007 


13009 


13033 


13037 


13043 


13049 


13063 


13093 


13099 


13103 


156. 


13109 


13121 


13127 


13147 


13151 


13159 


13163 


13171 


13177 


13183 


157. 


13187 


13217 


13219 


13229 


13241 


13249 


13259 


13267 


13291 


13297 


158. 


13309 


13313 


13327 


13331 


13337 


13339 


13367 


13381 


13397 


13399 


159. 


13411 


13417 


13421 


13441 


13451 


13457 


13463 


13469 


13477 


13487 


160. 


13499 


13513 


13523 


13537 


13553 


13567 


13577 


13591 


13597 


13613 


161. 


13619 


13627 


13633 


13649 


13669 


13679 


13681 


13687 


13691 


13693 


162. 


13697 


13709 


13711 


13721 


13723 


13729 


13751 


13757 


13759 


13763 


163. 


13781 


13789 


13799 


13807 


13829 


13831 


13841 


13859 


13873 


13877 


164. 


13879 


13883 


13901 


13903 


13907 


13913 


13921 


13931 


13933 


13963 


165. 


13967 


13997 


13999 


14009 


14011 


14029 


14033 


14051 


14057 


14071 


166. 


14081 


14083 


14087 


14107 


14143 


14149 


14153 


14159 


14173 


14177 


167. 


14197 


14207 


14221 


14243 


14249 


14251 


14281 


14293 


14303 


14321 


168. 


14323 


14327 


14341 


14347 


14369 


14387 


14389 


14401 


14407 


14411 


169. 


14419 


14423 


14431 


14437 


14447 


14449 


14461 


14479 


14489 


14503 


170. 


14519 


14533 


14537 


14543 


14549 


14551 


14557 


14561 


14563 


14591 


171. 


14593 


14621 


14627 


14629 


14633 


14639 


14653 


14657 


14669 


14683 


172. 


14699 


14713 


14717 


14723 


14731 


14737 


14741 


14747 


14753 


14759 


173. 


14767 


14771 


14779 


14783 


14797 


14813 


14821 


14827 


14831 


14843 


174. 


14851 


14867 


14869 


14879 


14887 


14891 


14897 


14923 


14929 


14939 


175. 


14947 


14951 


14957 


14969 


14983 


15013 


15017 


15031 


15053 


15061 


176. 


15073 


15077 


15083 


15091 


15101 


15107 


15121 


15131 


15137 


15139 


177. 


15149 


15161 


15173 


15187 


15193 


15199 


15217 


15227 


15233 


15241 


178. 


15259 


15263 


15269 


15271 


15277 


15287 


15289 


15299 


15307 


15313 


179. 


15319 


15329 


15331 


15349 


15359 


15361 


15373 


15377 


15383 


15391 


180. 


15401 


15413 


15427 


15439 


15443 


15451 


15461 


15467 


15473 


15493 


181. 


15497 


15511 


15527 


15541 


15551 
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877. 


90617 


90619 


90631 


90641 


90647 


90659 


90677 


90679 


90697 


90703 


878. 


90709 


90731 


90749 


90787 


90793 


90803 


90821 


90823 


90833 


90841 


879. 


90847 


90863 


90887 


90901 


90907 


90911 


90917 


90931 


90947 


90971 


880. 


90977 


90989 


90997 


91009 


91019 


91033 


91079 


91081 


91097 


91099 


881. 


91121 


91127 


91129 


91139 


91141 


91151 


91153 


91159 


91163 


91183 


882. 


91193 


91199 


91229 


91237 


91243 


91249 


91253 


91283 


91291 


91297 


883. 


91303 


91309 


91331 


91367 


91369 


91373 


91381 


91387 


91393 


91397 


884. 


91411 


91423 


91433 


91453 


91457 


91459 


91463 


91493 


91499 


91513 


885. 


91529 


91541 


91571 


91573 


91577 


91583 


91591 


91621 


91631 


91639 


886. 


91673 


91691 


91703 


91711 


91733 


91753 


91757 


91771 


91781 


91801 


887. 


91807 


91811 


91813 


91823 


91837 


91841 


91867 


91873 


91909 


91921 


888. 


91939 


91943 


91951 


91957 


91961 


91967 


91969 


91997 


92003 


92009 


889. 


92033 


92041 


92051 


92077 


92083 


92107 


92111 


92119 


92143 


92153 


890. 


92173 


92177 


92179 


92189 


92203 


92219 


92221 


92227 


92233 


92237 


891. 


92243 


92251 


92269 


92297 


92311 


92317 


92333 


92347 


92353 


92357 


892. 


92363 


92369 


92377 


92381 


92383 


92387 


92399 


92401 


92413 


92419 


893. 


92431 


92459 


92461 


92467 


92479 


92489 


92503 


92507 


92551 


92557 


894. 


92567 


92569 


92581 


92593 


92623 


92627 


92639 


92641 


92647 


92657 


895. 


92669 


92671 


92681 


92683 


92693 


92699 


92707 


92717 


92723 


92737 


896. 


92753 


92761 


92767 


92779 


92789 


92791 


92801 


92809 


92821 


92831 


897. 


92849 


92857 


92861 


92863 


92867 


92893 


92899 


92921 


92927 


92941 


898. 


92951 


92957 


92959 


92987 


92993 


93001 


93047 


93053 


93059 


93077 


899. 


93083 


93089 


93097 


93103 


93113 


93131 


93133 


93139 


93151 


93169 


900. 


93179 


93187 


93199 


93229 


93239 


93241 


93251 


93253 


93257 


93263 


901. 


93281 


93283 


93287 


93307 


93319 


93323 


93329 


93337 


93371 


93377 


902. 


93383 


93407 


93419 


93427 


93463 


93479 


93481 


93487 


93491 


93493 


903. 


93497 


93503 


93523 


93529 


93553 


93557 


93559 


93563 


93581 


93601 


904. 


93607 


93629 


93637 


93683 


93701 


93703 


93719 


93739 


93761 


93763 


905. 


93787 


93809 


93811 


93827 


93851 


93871 


93887 


93889 


93893 


93901 


906. 


93911 


93913 


93923 


93937 


93941 


93949 


93967 


93971 


93979 


93983 


907. 


93997 


94007 


94009 


94033 


94049 


94057 


94063 


94079 


94099 


94109 


908. 


94111 


94117 


94121 


94151 


94153 


94169 


94201 


94207 


94219 


94229 


909. 


94253 


94261 


94273 


94291 


94307 


94309 


94321 


94327 


94331 


94343 


910. 


94349 


94351 


94379 


94397 


94399 


94421 


94427 


94433 


94439 


94441 


911. 


94447 


94463 


94477 


94483 


94513 


94529 


94531 


94541 


94543 


94547 


912. 


94559 


94561 


94573 


94583 


94597 


94603 


94613 


94621 


94649 


94651 


913. 


94687 


94693 


94709 


94723 


94727 


94747 


94771 


94777 


94781 


94789 


914. 


94793 


94811 


94819 


94823 


94837 


94841 


94847 


94849 


94873 


94889 


915. 


94903 


94907 


94933 


94949 


94951 


94961 


94993 


94999 


95003 


95009 


916. 


95021 


95027 


95063 


95071 


95083 


95087 


95089 


95093 


95101 


95107 


917. 


95111 


95131 


95143 


95153 


95177 


95189 


95191 


95203 


95213 


95219 


918. 


95231 


95233 


95239 


95257 


95261 


95267 


95273 


95279 


95287 


95311 
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.0 


.1 


.2 


.3 


.4 


.5 


.6 


.7 


.8 


.9 


919. 


95317 


95327 


95339 


95369 


95383 


95393 


95401 


95413 


95419 


95429 


920. 


95441 


95443 


95461 


95467 


95471 


95479 


95483 


95507 


95527 


95531 


921. 


95539 


95549 


95561 


95569 


95581 


95597 


95603 


95617 


95621 


95629 


922. 


95633 


95651 


95701 


95707 


95713 


95717 


95723 


95731 


95737 


95747 


923. 


95773 


95783 


95789 


95791 


95801 


95803 


95813 


95819 


95857 


95869 


924. 


95873 


95881 


95891 


95911 


95917 


95923 


95929 


95947 


95957 


95959 


925. 


95971 


95987 


95989 


96001 


96013 


96017 


96043 


96053 


96059 


96079 


926. 


96097 


96137 


96149 


96157 


96167 


96179 


96181 


96199 


96211 


96221 


927. 


96223 


96233 


96259 


96263 


96269 


96281 


96289 


96293 


96323 


96329 


928. 


96331 


96337 


96353 


96377 


96401 


96419 


96431 


96443 


96451 


96457 


929. 


96461 


96469 


96479 


96487 


96493 


96497 


96517 


96527 


96553 


96557 


930. 


96581 


96587 


96589 


96601 


96643 


96661 


96667 


96671 


96697 


96703 


931. 


96731 


96737 


96739 


96749 


96757 


96763 


96769 


96779 


96787 


96797 


932. 


96799 


96821 


96823 


96827 


96847 


96851 


96857 


96893 


96907 


96911 


933. 


96931 


96953 


96959 


96973 


96979 


96989 


96997 


97001 


97003 


97007 


934. 


97021 


97039 


97073 


97081 


97103 


97117 


97127 


97151 


97157 


97159 


935. 


97169 


97171 


97177 


97187 


97213 


97231 


97241 


97259 


97283 


97301 


936. 


97303 


97327 


97367 


97369 


97373 


97379 


97381 


97387 


97397 


97423 


937. 


97429 


97441 


97453 


97459 


97463 


97499 


97501 


97511 


97523 


97547 


938. 


97549 


97553 


97561 


97571 


97577 


97579 


97583 


97607 


97609 


97613 


939. 


97649 


97651 


97673 


97687 


97711 


97729 


97771 


97777 


97787 


97789 


940. 


97813 


97829 


97841 


97843 


97847 


97849 


97859 


97861 


97871 


97879 


941. 


97883 


97919 


97927 


97931 


97943 


97961 


97967 


97973 


97987 


98009 


942. 


98011 


98017 


98041 


98047 


98057 


98081 


98101 


98123 


98129 


98143 


943. 


98179 


98207 


98213 


98221 


98227 


98251 


98257 


98269 


98297 


98299 


944. 


98317 


98321 


98323 


98327 


98347 


98369 


98377 


98387 


98389 


98407 


945. 


98411 


98419 


98429 


98443 


98453 


98459 


98467 


98473 


98479 


98491 


946. 


98507 


98519 


98533 


98543 


98561 


98563 


98573 


98597 


98621 


98627 


947. 


98639 


98641 


98663 


98669 


98689 


98711 


98713 


98717 


98729 


98731 


948. 


98737 


98773 


98779 


98801 


98807 


98809 


98837 


98849 


98867 


98869 


949. 


98873 


98887 


98893 


98897 


98899 


98909 


98911 


98927 


98929 


98939 


950. 


98947 


98953 


98963 


98981 


98993 


98999 


99013 


99017 


99023 


99041 


951. 


99053 


99079 


99083 


99089 


99103 


99109 


99119 


99131 


99133 


99137 


952. 


99139 


99149 


99173 


99181 


99191 


99223 


99233 


99241 


99251 


99257 


953. 


99259 


99277 


99289 


99317 


99347 


99349 


99367 


99371 


99377 


99391 


954. 


99397 


99401 


99409 


99431 


99439 


99469 


99487 


99497 


99523 


99527 


955. 


99529 


99551 


99559 


99563 


99571 


99577 


99581 


99607 


99611 


99623 


956. 


99643 


99661 


99667 


99679 


99689 


99707 


99709 


99713 


99719 


99721 


957. 


99733 


99761 


99767 


99787 


99793 


99809 


99817 


99823 


99829 


99833 


958. 


99839 


99859 


99871 


99877 


99881 


99901 


99907 


99923 


99929 


99961 


959. 


99971 


99989 


99991 


100003 


100019 


100043 


100049 


100057 


100069 


100103 



2.4.13 FACTORIZATION TABLE 

The following is a list of the factors of numbers up to and beyond 1,000. When a 
number is prime, it is shown in a bold face font. 





.0 


.1 


.2 


.3 


.4 


.5 .6 


.7 


.8 


.9 


0. 






2 


3 


2 2 


5 2-3 


7 


2 3 


3 2 


1. 


2-5 


11 


2 2 -3 


13 


2-7 


3-5 2 4 


17 


2-3 2 


19 


2. 


2 2 -5 


3-7 


2-11 


23 


2 3 -3 


5 2 2-13 


3 3 


2 2 -7 


29 


3. 


2-3-5 


31 


2 6 


3-11 


2-17 


5-7 2 2 -3 2 


37 


2-19 


313 


4. 


2 3 -5 


41 


2-3-7 


43 


2 2 -ll 


3 2 -5 2-23 


47 


2 4 -3 


7 2 


5. 


2-5 2 


3-17 2 2 -13 53 


2-3 3 


5-11 2 3 -7 


3-19 


2-29 


59 


6. 


2 2 -3-5 61 


2-31 


3 2 -7 2 6 


5-13 2-3-11 67 


2 2 -17 


3-23 


7. 


2-5-7 


71 


2 3 -3 2 


73 


2-37 


3-5 2 2 2 -19 


7-11 


2-3-13 


79 


8. 


2 4 -5 


3 4 


2-41 


83 


2 2 -3-7 5-17 2-43 


3-29 2 3 -ll 


89 


9. 


2-3 2 -5 


7-13 


2 2 -23 


3-31 


2-47 


5-19 2 6 -3 


97 


2-7 2 


3 2 -ll 
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.0 


.1 


.2 


.3 


.4 


10. 


2 2 -5 2 


101 


2-3-17 


103 


2 3 -13 


11. 


2-5-11 


3-37 


2 4 -7 


113 


2-3-19 


12. 


2 3 -3-5 


ll 2 


2-61 


3-41 


2 2 -31 


13. 


2-5-13 


131 


2 2 -3-ll 


7-19 


2-67 


14. 


2 2 -5-7 


3-47 


2-71 


11-13 


2 4 -3 2 


15. 


2-3-5 2 


151 


2 3 -19 


3 2 -17 


2-7-11 


16. 


2 6 -5 


7-23 


2-3 4 


163 


2 2 -41 


17. 


2-5-17 


3 2 -19 


2 2 -43 


173 


2-3-29 


18. 


2 2 -3 2 -5 


181 


2-7-13 


3-61 


2 3 -23 


19. 


2-5-19 


191 


2 6 -3 


193 


2-97 


20. 


2 3 -5 2 


3-67 


2-101 


7-29 


2 2 -3-17 


21. 


2-3-5-7 


211 


2 2 -53 


3-71 


2-107 


22. 


2 2 -5-ll 


13-17 


2-3-37 


223 


2 6 -7 


23. 


2-5-23 


3-7-11 


2 3 -29 


233 


2-3 2 -13 


24. 


2 4 -3-5 


241 


2-11 2 


3 6 


2 2 -61 


25. 


2-5 3 


251 


2 2 -3 2 -7 


11-23 


2-127 


26. 


2 2 -5-13 


3 2 -29 


2-131 


263 


2 3 -3-ll 


27. 


2-3 3 -5 


271 


2 4 -17 


3-7-13 


2-137 


28. 


2 3 -5-7 


281 


2-3-47 


283 


2 2 -71 


29. 


2-5-29 


3-97 


2 2 -73 


293 


2-3-7 2 


30. 


2 2 -3-5 2 


7-43 


2-151 


3-101 


2 4 -19 


31. 


2-5-31 


311 


2 3 -3-13 


313 


2-157 


32. 


2 6 -5 


3-107 


2-7-23 


17-19 


2 2 -3 4 


33. 


2-3-5-11 


331 


2 2 -83 


3 2 -37 


2-167 


34. 


2 2 -5-17 


11-31 


2-3 2 -19 


7 3 


2 3 -43 


35. 


2-5 2 -7 


3 3 -13 


2 6 -ll 


353 


2-3-59 


36. 


2 3 -3 2 -5 


19 2 


2-181 


3-11 2 


2 2 -7-13 


37. 


2-5-37 


7-53 


2 2 -3-31 


373 


2-11-17 


38. 


2 2 -5-19 


3-127 


2-191 


383 


2 7 -3 


39. 


2-3-5-13 


17-23 


2 3. 7 2 


3-131 


2-197 


40. 


2 4 -5 2 


401 


2-3-67 


13-31 


2 2 -101 


41. 


2-5-41 


3-137 


2 2 -103 


7-59 


2-3 2 -23 


42. 


2 2 -3-5-7 


421 


2-211 


3 2 -47 


2 3 -53 


43. 


2-5-43 


431 


2 4 -3 3 


433 


2-7-31 


44. 


2 3 -5-ll 


3 2 -7 2 


2-13-17 


443 


2 2 -3-37 


45. 


2-3 2 -5 2 


11-41 


2 2 -113 


3-151 


2-227 


46. 


2 2 -5-23 


461 


2-3-7-11 


463 


2 4 -29 


47. 


2-5-47 


3-157 


2 3 -59 


11-43 


2-3-79 


48. 


2 6 -3-5 


13-37 


2-241 


3-7-23 


2 2 -ll 2 


49. 


2-5-7 2 


491 


2 2 -3-41 


17-29 


2-13-19 


50. 


2 2 -5 3 


3-167 


2-251 


503 


2 3 -3 2 -7 


51. 


2-3-5-17 


7-73 


2 9 


3 3 -19 


2-257 


52. 


2 3 -5-13 


521 


2-3 2 -29 


523 


2 2 -131 


53. 


2-5-53 


3 2 -59 


2 2 -7-19 


13-41 


2-3-89 


54. 


2 2 -3 3 -5 


541 


2-271 


3-181 


2 6 -17 


55. 


2-5 2 -11 


19-29 


2 3 -3-23 


7-79 


2-277 


56. 


2 4 -5-7 


3-11-17 2-281 


563 


2 2 -3-47 


57. 


2-3-5-19 


571 


2 2 -ll-13 


3-191 


2-7-41 


58. 


2 2 -5-29 


7-83 


2-3-97 


11-53 


2 3 -73 


59. 


2-5-59 


3-197 


2 4 -37 


593 


2-3 3 -ll 


60. 


2 3 -3-5 2 


601 


2-7-43 


3 2 -67 


2 2 -151 


61. 


2-5-61 


13-47 


2 2 -3 2 -17 613 


2-307 



3-5-7 

5-23 

5 3 

3 3 - 5 
29 
31 
5-11 
! -7 
37 
5-13 
41 
43 
! -5 2 
47 
7 2 

5-17 

53 

! -ll 

5-19 

59 

61 
3 2 -5-7 
5 2 -13 
5-67 
3-5-23 
5-71 
5-73 
3-5 3 
5-7-11 
5-79 

3 4 - 5 
5-83 
5 2 -17 
3-5-29 
5-89 
5-7-13 
3-5-31 
5 2 -19 
5-97 
3 2 -5-ll 

101 
103 
5 2 -7 
107 
109 
5-37 
113 
23 



3 2 -5-13 
5-7-17 
5-11 2 
3-5-41 



.6 

2-53 

2 2 - 29 
2-3 2 -7 

2 3 - 17 
2-73 

2 2 - 3-13 
2-83 

2 4 - ll 
2-3-31 

2 2. 7 2 

2-103 

2 3 - 3 3 
2-113 
2 2 -59 
2-3-41 
2 8 

2-7-19 

2 2 - 3-23 
2-11-13 

2 3 - 37 
2-3 2 -17 
2 2 -79 
2-163 

2 4 - 3-7 
2-173 

2 2 - 89 
2-3-61 

2 3 - 47 
2-193 
2 2 -3 2 -ll 
2-7-29 
2 6 -13 
2-3-71 

2 2 - 109 
2-223 

2 3 - 3-19 
2-233 
2 2 -7-17 
2-3 6 

2 4 - 31 
2-11-23 

2 2 - 3-43 
2-263 

2 3 - 67 
2-3-7-13 
2 2 -139 
2-283 
2 6 -3 2 
2-293 

2 2 - 149 
2-3-101 

2 3 - 7-ll 



.7 
107 

3 2 -13 

127 

137 

3-7 2 

157 

167 

3-59 

11-17 

197 

3 2 - 23 
7-31 
227 
3-79 
13-19 
257 
3-89 
277 
7-41 

3 3 - ll 
307 
317 
3-109 
337 
347 
3-7-17 
367 
13-29 
3 2 -43 
397 
11-37 
3-139 
7-61 
19-23 
3-149 
457 
467 
3 2 -53 
487 
7-71 
3-13 2 
11-47 
17-31 
3-179 
547 
557 

3 4 - 7 
577 
587 
3-199 
607 
617 



2 2 -3 3 

2-59 

2 7 

2-3-23 

2 2 - 37 
2-79 

2 3 - 3-7 
2-89 
2 2 -47 
2-3 2 -ll 

2 4 - 13 
2-109 

2 2 - 3-19 
2-7-17 

2 3 - 31 
2-3-43 
2 2 -67 
2-139 
2 6 -3 2 
2-149 

2 2 - 7-ll 
2-3-53 

2 3 - 41 
2-13 2 
2 2 -3-29 
2-179 

2 4 - 23 
2-3 3 -7 

2 2 - 97 
2-199 

2 3 - 3-17 
2-11-19 
2 2 -107 
2-3-73 
2 6 -7 
2-229 

2 2 - 3 2 
2-239 

2 3 - 61 
2-3-83 
2 2 -127 
2-7-37 

2 4 - 3-ll 
2-269 

2 2 - 137 
2-3 2 -31 

2 3 - 71 
2-17 2 
2 2 -3-7 2 
2-13-23 
2 6 -19 
2-3-103 



13 



109 

7-17 

3-43 

139 

149 

3-53 

13 2 

179 

3 3 -7 

199 

11-19 

3-73 

229 

239 

3-83 

7-37 

269 

3 2 -31 

17 2 

13-23 

3-103 

11-29 

7-47 

3-113 

349 

359 

3 2 - 41 
379 
389 
3-7-19 
409 
419 

3-11-13 

439 

449 

3 3 - 17 
7-67 
479 
3-163 
499 
509 
3-173 
23 2 
7 2 -ll 
3 2 -61 
13-43 
569 
3-193 
19-31 
599 
3-7-29 
619 
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.0 



J 



.2 



.3 



2 2 -5-31 
2-3 2 -5-7 
2 7 -5 
2-5 2 -13 

2 2 - 3-5-ll 
2-5-67 

2 3 - 5-17 
2-3-5-23 
2 2 -5 2 -7 
2-5-71 

2 4 - 3 2 -5 
2-5-73 

2 2 - 5-37 
2-3-5 3 

2 3 - 5-19 
2-5-7-11 
2 2 -3-5-13 
2-5-79 
2 6 -5 2 
2-3 4 -5 

2 2 - 5-41 
2-5-83 

2 3 - 3-5-7 
2-5 2 -17 
2 2 -5-43 
2-3-5-29 

2 4 - 5-ll 
2-5-89 

2 2 - 3 2 -5 2 
2-5-7-13 

2 3 - 5-23 
2-3-5-31 
2 2 -5-47 
2-5 2 -19 
2 6 -3-5 
2-5-97 

2 2 - 5-7 2 
2-3 2 -5-ll 

2 3 - 5 3 
2-5-101 
2 2 -3-5-17 
2-5-103 

2 4 - 5-13 
2-3-5 2 -7 

2 2 - 5-53 
2-5-107 

2 3 - 3 3 -5 
2-5-109 
2 2 -5 2 -ll 
2-3-5-37 
2 6 -5-7 



_4 

2 4 -3-13 
2-317 

2 2 - 7-23 
2-3-109 

2 3 - 83 
2-337 
2 2 -3 2 -19 
2-347 
2 6 -ll 
2-3-7-17 

2 2 - 181 
2-367 

2 3 - 3-31 
2-13-29 
2 2 -191 
2-3 2 -43 

2 4 - 7 2 
2-397 

2 2 - 3-67 
2-11-37 

2 3 - 103 
2-3-139 
2 2 -211 
2-7-61 
2 6 -3 3 
2-19-23 

2 2 - 13-17 
2-3-149 

2 3 - 113 
2-457 
2 2 -3-7-ll 
2-467 

2 4 - 59 
2-3 2 -53 

2 2 - 241 
2-487 

2 3 - 3-41 

2-7-71 

2 2 -251 

2-3-13 2 
2 io 

2-11-47 

2 2 - 3 2 -29 
2-17-31 

2 3 - 7-19 
2-3-179 
2 2 -271 
2-547 

2 4 - 3-23 
2-557 
2 2 -281 



.6 



2 2 - 157 
2-11-29 

2 3 - 3 4 
2-7-47 
2 2 -167 
2-3-113 

2 4 - 43 
2-349 

2 2 - 3-59 
2-359 

2 3 - 7-13 
2-3 2 -41 
2 2 -ll-17 
2-379 
2 8 -3 
2-389 

2 2 - 197 
2-3-7-19 

2 3 - 101 
2-409 
2 2 -3 2 -23 
2-419 

2 4 - 53 
2-3-11-13 

2 2 - 7-31 
2-439 

2 3 - 3-37 
2-449 
2 2 -227 
2-3 3 -17 
2 6 -29 
2-7-67 

2 2 - 3-79 
2-479 

2 3 - ll 2 
2-3-163 
2 2 -13-19 
2-499 

2 4 - 3 2 -7 
2-509 

2 2 - 257 
2-3-173 

2 3 - 131 
2-23 2 
2 2 -3-89 
2-7 2 -ll 
2 6 -17 
2-3 2 -61 

2 2 - 277 
2-13-43 

2 3 - 3-47 



62. 
63. 
64. 
65. 
66. 
67. 
68. 
69. 
70. 
71. 
72. 
73. 
74. 
75. 
76. 
77. 
78. 
79. 
80. 
81. 
82. 
83. 
84. 
85. 
86. 
87. 
88. 
89. 
90. 
91. 
92. 
93. 
94. 
95. 
96. 
97. 



100. 
101. 
102. 
103. 
104. 
105. 
106. 
107. 
108. 
109. 
110. 
111. 
112. 



3 3 - 23 
631 
641 

3-7-31 

661 

11-61 

3-227 

691 

701 

3 2 -79 

7-103 

17-43 

3-13-19 

751 

761 

3-257 

11-71 

7-113 

3 2 -89 

811 

821 

3-277 

29 2 

23-37 

3-7-41 

13-67 

881 

3 4 - ll 
17-53 
911 
3-307 
7 2 -19 
941 
3-317 
31 2 
971 

3 2 -109 
991 

7-11-13 

3-337 

1021 

1031 

3-347 

1051 

1061 

3 2 -7-17 

23-47 

1091 

3-367 

11-101 

19-59 



2-311 
2 3 -79 
2-3-107 

2 2 - 163 
2-331 

2 3 - 3-7 
2-11-31 

2 2 - 173 
2-3 3 -13 

2 3 - 89 
2-19 2 
2 2 -3-61 
2-7-53 

2 4 - 47 
2-3-127 

2 2 - 193 
2-17-23 

2 3 - 3 2 -ll 
2-401 
2 2 -7-29 
2-3-137 
2 6 -13 
2-421 

2 2 - 3-71 
2-431 

2 3 - 109 
2-3 2 -7 2 
2 2 -223 
2-11-41 

2 4 - 3-19 
2-461 

2 2 - 233 
2-3-157 

2 3 - 7-17 
2-13-37 
2 2 -3 6 
2-491 
2 6 -31 
2-3-167 

2 2 - ll-23 
2-7-73 

2 3 - 3-43 
2-521 
2 2 -263 
2-3 2 -59 

2 4 - 67 
2-541 

2 2 - 3-7-13 
2-19-29 

2 3 - 139 
2-3-11-17 



7-89 
3-211 
643 
653 

3-13-17 

673 

683 

3 2 - 7-ll 
19-37 
23-31 
3-241 
733 
743 
3-251 
7-109 
773 

3 3 - 29 
13-61 
11-73 
3-271 
823 
7 2 -17 
3-281 
853 
863 
3 2 -97 
883 
19-47 
3-7-43 
11-83 
13-71 
3-311 
23-41 
953 

3 2 -107 

7-139 

983 

3-331 

17-59 

1013 

3-11-31 

1033 

7-149 

3 4 - 13 
1063 
29-37 
3-19 2 
1093 
1103 
3-7-53 
1123 



•127 
•5-43 
•131 
•7-19 
5 2 
•137 
•139 
•5-47 
•11-13 

29 
•5-7 2 
•149 
•151 
3 2 -5-17 
5 2 -31 
•157 
•5-53 
•7-23 
•163 
•5 2 -ll 
•167 
•13 2 

5-19 
•173 
7 

•5-59 
•179 
•181 
•5-61 
37 
•11-17 

5-7 
•191 
•193 
•5 2 -13 
5-197 
5-199 
3-5-67 
5-7-29 
5 2 -41 
3 2 -5-23 
5-11-19 
5-211 
3-5-71 
5 2 -43 
5-7-31 
3-5-73 
5-13-17 
5-223 
3 2 -5 3 



5 

3 

5 

5- 

3- 

5- 

5- 

3 2 

5- 

5 3 - 

3- 

5 

5 

3 

5' 

5 

3 3 - 
5- 

5 
3 



2-313 

2 2 -3-53 

2-17-19 

2 4 -41 

2-3 2 -37 

2 2 - 13 2 
2-7 3 

2 3 - 3-29 
2-353 
2 2 -179 
2-3-11 2 

2 6 - 23 
2-373 

2 2 - 3 3 -7 
2-383 

2 3 - 97 
2-3-131 
2 2 -199 
2-13-31 

2 4 - 3-17 
2-7-59 

2 2 - ll-19 
2-3 2 -47 

2 3 - 107 
2-433 
2 2 -3-73 
2-443 

2 7 - 7 
2-3-151 

2 2 - 229 
2-463 

2 3 - 3 2 -13 
2-11-43 
2 2 -239 
2-3-7-23 

2 4 - 61 
2-17-29 

2 2 - 3-83 
2-503 

2 3 - 127 
2-3 3 -19 
2 2 -7-37 
2-523 
2 6 -3-ll 
2-13-41 

2 2 - 269 
2-3-181 

2 3 - 137 
2-7-79 
2 2 -3 2 -31 
2-563 



3-11-19 

7 2 -13 

647 

3 2 -73 

23-29 

677 

3-229 

17-41 

7-101 

3-239 

727 

11-67 

3 2 - 83 
757 
13-59 
3-7-37 
787 
797 
3-269 
19-43 
827 

3 3 - 31 
7-11 2 
857 
3-17 2 
877 
887 

3-13-23 

907 

7-131 

3 2 -103 

937 

947 

3-11-29 

967 

977 

3-7-47 

997 

19-53 

3 2 - 113 
13-79 
17-61 
3-349 
7-151 
11-97 
3-359 
1087 
1097 

3 3 - 41 
1117 
7 2 -23 



17-37 

3 2 -71 

11-59 

659 

3-223 

7-97 

13-53 

3-233 

709 

719 

3 6 

739 

7-107 

3-11-23 

769 

19-41 

3-263 

17-47 

809 

3 2 -7-13 

829 

839 

3-283 

859 

11-79 

3-293 

7-127 

29-31 

3 2 - 101 
919 
929 
3-313 
13-73 
7-137 
3-17-19 
11-89 
23-43 

3 3 - 37 
1009 
1019 
3-7 3 
1039 
1049 
3-353 
1069 
13-83 
3 2 -ll 2 
7-157 
1109 
3-373 
1129 
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2.4.1 4 FACTORIZATION OF 2™ - 1 



2 3 - 1 
z- 


— 7 

L — I 


ol9 i 

Zi — J. 




^94987 

UZ4:ZO ( 


o4 -, 

Zj J 


— 3 V ^ 

— O A O 


o20 1 
z — X 




tv I 2 ¥ 11 Y ^l ¥ i1 
O A (J A XX A OX A *±X 


2 5 — ' 


— 31 


2 21 — 1 




7 2 v 1 97 v 337 
1 A 1Z ; A OO ( 


2 6 -] 


L = 3 2 x 7 


2 22 _ 1 


— 


3 x 23 x 89 x 683 


2 7 -: 


I = 127 


2 23 _ j 


= 


47 x 178481 


z- 


— O A (J A J. J 


o24 i 
z — J. 




3 2 y ^y7y11v17y 941 

O A O A I A XO A X I A ill 


Z- 


L — 4 A JO 


o25 1 
z — J. 




31 v fim v i sni 

OX A UUX A XOUX 


olO 

Z* — 


1 - Q Y 11 V 31 
1 — O A 11 A Ol 


2 26 _ ^ 




3 v 9731 v SI Q1 
O A ii Ol A oiyi 


2 11 - 


1 = 23 x 89 


2 27 - 1 


— 


7 x 73 x 262657 


2 12 _ 


1 = 3 2 x 5 x 7 x 13 


2 28 _ j 


= 


3 x 5 x 29 x 43 x 113 x 127 


2 13 _ 


1 = 8191 


2 29 — 1 




233 x 1103 x 2089 


2 14 _ 


1 = 3 x 43 x 127 


2 30 _ j 




3 2 x 7 x 11 x 31 x 151 x 331 


2 15 _ 


1 = 7 x 31 x 151 


2 31 - 1 




2147483647 


2 16 _ 


1 = 3 x 5 x 17 x 257 


2 32 _ j 




3 x 5 x 17 x 257 x 65537 


2 17 - 


1 = 131071 


2 33 _ j 




7 x 23 x 89 x 599479 


2 18 _ 


1 = 3 3 x 7 x 19 x 73 


2 34 -l 




3 x 43691 x 131071 



2.4.15 EULER TOTIENT FUNCTION 

2.4.15.1 De nitions 

1 . <f){n) the totient function is the number of integers not exceeding and 

relatively prime to n. 

2. a(n) is the sum of the divisors of n. 

3. r(n) is the number of divisors of n. (Also called the d(n) function.) 

De ne au{n) to be the k th divisor function, the sum of the k th powers of the 
divisors of n. Then r(n) = ao(n) and a(n) = o\ (n). 

EXAMPLE The numbers less than 6 and relatively prime to 6 are {1, 5}. Hence 0(6) = 
2. The divisors of 6 are {1, 2, 3, 6}. There are r(6) = 4 divisors. The sum of these 
numbers is cr(6) = 1 + 2 + 3 + 6 = 12. 

2.4.15.2 Properties of the totient function 

1. cp is a multiplicative function: if (n,m) = 1, then <j>{nm) = (j>(m)(j>(n). 

2. If p is prime, then <j>{p) = p — 1. 

3. Gauss's theorem states: n = 2~2d\n ^( c 0- 

4. When n = JJ « > an d the {Pi\ are prime 

g/fc ( n ) = Vd* = TT gj . - . (2.4.17) 
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5. Generating functions 



E 



. n 

n—l 



E 



(2.4.18) 

4>(n) _ C(s - 1) 
„ =1 ^ CW 

A perfect number n satis es <r(n) = 2n. The integer n is an even perfect 
number if, and only if, n = 2 m_1 (2 m — 1), where to is a positive integer such 
that M m = 2 m — 1 is a Mersenne prime. The sequence of perfect numbers is 

{6, 28, 496, . . . } (see page 31), corresponding to to = 2, 3, 5, It is not 

known whether there exists an odd perfect number. 



2.4.15.3 Table of totient function values 





rh(n\ 
<P\ n ) 


r(n) 


a(n) 




4>(n) 


r(n) 


<r(n) 




4>(n) 


r(n) 


<r(n) 




4>(n) 


r(n) 


a(n) 


1 





1 


1 


2 


1 


2 


3 


3 


2 


2 


4 


4 


2 


3 


1 


5 


4 


2 


6 


6 


2 


4 


12 


7 


6 


2 


8 


8 


4 


4 


15 


9 


6 


3 


13 


10 


4 


4 


18 


11 


10 


2 


12 


12 


4 


6 


28 


13 


12 


2 


14 


14 


6 


4 


24 


15 


8 


4 


24 


16 


8 


5 


31 


17 


16 


2 


18 


18 


6 


6 


39 


19 


18 


2 


20 


20 


8 


6 


42 


21 


12 


4 


32 


22 


10 


4 


36 


23 


22 


2 


24 


24 


8 


8 


60 


25 


20 


3 


31 


26 


12 


4 


42 


27 


18 


4 


40 


28 


12 


6 


56 


29 


28 


2 


30 


30 


8 


8 


72 


31 


30 


2 


32 


32 


16 


6 


63 


33 


20 


4 


48 


34 


16 


4 


54 


35 


24 


4 


48 


36 


12 


9 


91 


37 


36 


2 


38 


38 


18 


4 


60 


39 


24 


4 


56 


40 


16 


8 


90 


41 


40 


2 


42 


42 


12 


8 


96 


43 


42 


2 


44 


44 


20 


6 


84 


45 


24 


6 


78 


46 


22 


4 


72 


47 


46 


2 


48 


48 


16 


10 


124 


49 


42 


3 


57 


50 


20 


6 


93 


51 


32 


4 


72 


52 


24 


6 


98 


53 


52 


2 


54 


54 


18 


8 


120 


55 


40 


4 


72 


56 


24 


8 


120 


57 


36 


4 


80 


58 


28 


4 


90 


59 


58 


2 


60 


60 


16 


12 


168 


61 


60 


2 


62 


62 


30 


4 


96 


63 


36 


6 


104 


64 


32 


7 


127 


65 


48 


4 


84 


66 


20 


8 


144 


67 


66 


2 


68 


68 


32 


6 


126 


69 


44 


4 


96 


70 


24 


8 


144 


71 


70 


2 


72 


72 


24 


12 


195 


73 


72 


2 


74 


74 


36 


4 


114 


75 


40 


6 


124 


76 


36 


6 


140 


77 


60 


4 


96 


78 


24 


8 


168 


79 


78 


2 


80 


80 


32 


10 


186 


81 


54 


5 


121 


82 


40 


4 


126 


83 


82 


2 


84 


84 


24 


12 


224 


85 


64 


4 


108 


86 


42 


4 


132 


87 


56 


4 


120 


88 


40 


8 


180 


89 


88 


2 


90 


90 


24 


12 


234 


91 


72 


4 


112 


92 


44 


6 


168 


93 


60 


4 


128 


94 


46 


4 


144 


95 


72 


4 


120 


96 


32 


12 


252 


97 


96 


2 


98 


98 


42 


6 


171 


99 


60 


6 


156 


100 


40 


9 


217 


101 


100 


2 


102 


102 


32 


8 


216 


103 


102 


2 


104 


104 


48 


8 


210 


105 


48 


8 


192 


106 


52 


4 


162 


107 


106 


2 


108 


108 


36 


12 


280 


109 


108 


2 


110 


110 


40 


8 


216 


111 


72 


4 


152 


112 


48 


10 


248 


113 


112 


2 


114 


114 


36 


8 


240 


115 


88 


4 


144 


116 


56 


6 


210 


117 


72 


6 


182 


118 


58 


4 


180 


119 


96 


4 


144 


120 


32 


16 


360 
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n 


4>(n) 


r(n) 


<r(n) 


n 


4>(n) 


r(n) 


<r(n) 


n 


4>(n) 


r(n) 


<r(n) 


n 


4>(n) 


r(n) 


<r(n) 


121 


110 


3 


133 


122 


60 


4 


186 


123 


80 


4 


168 


124 


60 


6 


224 


125 


100 


4 


156 


126 


36 


12 


312 


127 


126 


2 


128 


128 


64 


8 


255 


129 


84 


4 


176 


130 


48 


8 


252 


131 


130 


2 


132 


132 


40 


12 


336 


133 


108 


4 


160 


134 


66 


4 


204 


135 


72 


8 


240 


136 


64 


8 


270 


137 


136 


2 


138 


138 


44 


8 


288 


139 


138 


2 


140 


140 


48 


12 


336 


141 


92 


4 


192 


142 


70 


4 


216 


143 


120 


4 


168 


144 


48 


15 


403 


145 


112 


4 


180 


146 


72 


4 


222 


147 


84 


6 


228 


148 


72 


6 


266 


149 


148 


2 


150 


150 


40 


12 


372 


151 


150 


2 


152 


152 


72 


8 


300 


153 


96 


6 


234 


154 


60 


8 


288 


155 


120 


4 


192 


156 


48 


12 


392 


157 


156 


2 


158 


158 


78 


4 


240 


159 


104 


4 


216 


160 


64 


12 


378 


161 


132 


4 


192 


162 


54 


10 


363 


163 


162 


2 


164 


164 


80 


6 


294 


165 


80 


8 


288 


166 


82 


4 


252 


167 


166 


2 


168 


168 


48 


16 


480 


169 


156 


3 


183 


170 


64 


8 


324 


171 


108 


6 


260 


172 


84 


6 


308 


173 


172 


2 


174 


174 


56 


8 


360 


175 


120 


6 


248 


176 


80 


10 


372 


177 


116 


4 


240 


178 


88 


4 


270 


179 


178 


2 


180 


180 


48 


18 


546 


181 


180 


2 


182 


182 


72 


8 


336 


183 


120 


4 


248 


184 


88 


8 


360 


185 


144 


4 


228 


186 


60 


8 


384 


187 


160 


4 


216 


188 


92 


6 


336 


189 


108 


8 


320 


190 


72 


8 


360 


191 


190 


2 


192 


192 


64 


14 


508 


193 


192 


2 


194 


194 


96 


4 


294 


195 


96 


8 


336 


196 


84 


9 


399 


197 


196 


2 


198 


198 


60 


12 


468 


199 


198 


2 


200 


200 


80 


12 


465 


201 


132 


4 


272 


202 


100 


4 


306 


203 


168 


4 


240 


204 


64 


12 


504 


205 


160 


4 


252 


206 


102 


4 


312 


207 


132 


6 


312 


208 


96 


10 


434 


209 


180 


4 


240 


210 


48 


16 


576 


211 


210 


2 


212 


212 


104 


6 


378 


213 


140 


4 


288 


214 


106 


4 


324 


215 


168 


4 


264 


216 


72 


16 


600 


217 


180 


4 


256 


218 


108 


4 


330 


219 


144 


4 


296 


220 


80 


12 


504 


221 


192 


4 


252 


222 


72 


8 


456 


223 


222 


2 


224 


224 


96 


12 


504 


225 


120 


9 


403 


226 


112 


4 


342 


227 


226 


2 


228 


228 


72 


12 


560 


229 


228 


2 


230 


230 


88 


8 


432 


231 


120 


8 


384 


232 


112 


8 


450 


233 


232 


2 


234 


234 


72 


12 


546 


235 


184 


4 


288 


236 


116 


6 


420 


237 


156 


4 


320 


238 


96 


8 


432 


239 


238 


2 


240 


240 


64 


20 


744 


241 


240 


2 


242 


242 


110 


6 


399 


243 


162 


6 


364 


244 


120 


6 


434 


245 


168 


6 


342 


246 


80 


8 


504 


247 


216 


4 


280 


248 


120 


8 


480 


249 


164 


4 


336 


250 


100 


8 


468 


251 


250 


2 


252 


252 


72 


18 


728 


253 


220 


4 


288 


254 


126 


4 


384 


255 


128 


8 


432 


256 


128 


9 


511 


257 


256 


2 


258 


258 


84 


8 


528 


259 


216 


4 


304 


260 


96 


12 


588 


261 


168 


6 


390 


262 


130 


4 


396 


263 


262 


2 


264 


264 


80 


16 


720 


265 


208 


4 


324 


266 


108 


8 


480 


267 


176 


4 


360 


268 


132 


6 


476 


269 


268 


2 


270 


270 


72 


16 


720 


271 


270 


2 


272 


272 


128 


10 


558 


273 


144 


8 


448 


274 


136 


4 


414 


275 


200 


6 


372 


276 


88 


12 


672 


277 


276 


2 


278 


278 


138 


4 


420 


279 


180 


6 


416 


280 


96 


16 


720 


281 


280 


2 


282 


282 


92 


8 


576 


283 


282 


2 


284 


284 


140 


6 


504 


285 


144 


8 


480 


286 


120 


8 


504 


287 


240 


4 


336 


288 


96 


18 


819 


289 


272 


3 


307 


290 


112 


8 


540 


291 


192 


4 


392 


292 


144 


6 


518 


293 


292 


2 


294 


294 


84 


12 


684 


295 


232 


4 


360 


296 


144 


8 


570 


297 


180 


8 


480 


298 


148 


4 


450 


299 


264 


4 


336 


300 


80 


18 


868 


301 


252 


4 


352 


302 


150 


4 


456 


303 


200 


4 


408 


304 


144 


10 


620 


305 


240 


4 


372 


306 


96 


12 


702 


307 


306 


2 


308 


308 


120 


12 


672 
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2.5 VECTOR ALGEBRA 



2.5.1 NOTATION FOR VECTORS AND SCALARS 

A vector is an ordered n-tuple of values. A vector is usually represented by a lower- 
case, bold-faced letter, such as v. The individual components of a vector v are typ- 
ically denoted by a lower-case letter along with a subscript identifying the relative 
position of the component in the vector, such as v = [v i , vi , . . . , v n ] . In this case, 
the vector is said to be n-dimensional. If the n individual components of the vector 
are real numbers, then v G 1". Similarly, if the n components of v are complex, 
thenveC™. 

Subscripts are also typically used to identify individual vectors within a set of 
vectors all belonging to the same type. For example, a set of n velocity vectors can 
be denoted by {vi, . . . , v„}. In this case, a bold-face type is used on the individual 
members of the set to signify these elements of the set are vectors and not vector 
components. 

Two vectors, v and u, are said to be equal if all their components are equal. The 
negative of a vector, written as — v, is one that acts in a direction opposite to v, but is 
of equal magnitude. 



2.5.2 PHYSICAL VECTORS 

Any quantity that is completely determined by its magnitude is called a scalar. For 
example, mass, density, and temperature are scalars. Any quantity that is completely 
determined by its magnitude and direction is called, in physics, a vector. We often 
use a three-dimensional vector to represent a physical vector. Examples of physical 
vectors include velocity, acceleration, and force. A physical vector is represented by 
a directed line segment, the length of which represents the magnitude of the vector. 
Two vectors are said to be parallel if they have exactly the same direction, i.e., the 
angle between the two vectors equals zero. 



2.5.3 FUNDAMENTAL DEFINITIONS 

1 . A row vector is a vector whose components are aligned horizontally. A column 
vector has its components aligned vertically. The transpose operator, denoted 
by the superscript T , switches the orientation of a vector between horizontal 
and vertical. 
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EXAMPLE 



v= [1,2,3,4], v T 



row vector 



column vector 



(v T ) T = [1,2,3,4]. 



row vector 



Vectors are traditionally written with either parentheses or with square brack- 
ets. 

2. Two vectors, v and u, are said to be orthogonal if v T u = 0. (This is also 
written v • u = 0, where the "•" denotes an inner product; see page 133.) 

3. A set of vectors {vi , . . . , v„} is said to be orthogonal if vjv,- = for all i ^ j. 

4. A set of orthogonal vectors {vi , . . . , v m } is said to be orthonormal if, in addi- 
tion to possessing the property of orthogonality, the set possesses the property 
that v, T v, = 1 for all 1 < i < m. 



2.5.4 LAWS OF VECTOR ALGEBRA 



1 . The vector sum of v and u, represented by v + u, results in another vector of 
the same dimension, and is calculated by simply adding corresponding vector 
components, e.g., if v, u € M n , then v + u = [v\ + u\ , . . . , v n + u n ]. 



2. The vector subtraction of u from v, represented by v 
addition of v and — u. 



u, is equivalent to the 



3. If r > is a scalar, then the scalar multiplication rv (equal to vr) represents 
a scaling by a factor r of the vector v in the same direction as v. That is, the 
multiplicative scalar is distributed to each component of v. 

4. If < r < 1, then the scalar multiplication of r and v shrinks the length of v, 
multiplication by r = 1 leaves v unchanged, and, if r > 1, then rv stretches 
the length of v. When r < 0, scalar multiplication of r and v has the same 
effect on the magnitude (length) of v as when r > 0, but results in a vector 
oriented in the direction opposite to v. 

EXAMPLE 



T 




'4" 




T 




' -4" 










-4 










3 




12 




3 




-12 



5. If r and s are scalars, and v, u, and w are vectors, the following rules of algebra 
are valid: 



V + U = U + V, 

(r + s)v = rv + s\ = vr + vs = v(r + s), 
r(v + u) = rv + ru, 
v + (u + w) = (v + u) + w = v + u + w. 



(2.5.1) 
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2.5.5 VECTOR NORMS 

1. A norm is the vector analog to the measure of absolute value for real scalars. 
Norms provide a distance measure for a vector space. 

2. A vector norm applied to a vector v is denoted by a double bar notation ||v||. 
(Single bar notation, |v|, is also sometimes used). 

3. A norm on a vector space equips it with a metric space structure. 

4. The properties of a vector norm are: 

(a) For any vector v ^ 0, ||v|| > 0, 

(b) || 7 v|| = |7| 1 1 v 1 1 , and 

(c) ||v + u|| < ||v|| + 1 1 u 1 1 (triangle inequality). 

5. The three most commonly used vector norms on K " or C™ are 

(a) The L\ norm is de ned as ||v||j = \v\ \ + ■ ■ ■ + \v n \ = Y17=i \ v i\- 

(b) The 1/2 norm (Euclidean norm) is de ned as 

iivii 2 = (m 2 + hi 2 + • • • + M 2 ) 1 / 2 = f J • < 2 - 5 - 2 ) 

(c) The Lqo norm is de ned as IMloo = max \ v i\- 

l<i<n 

6. In the absence of any subscript, the norm 1 1 • | is usually assumed to be the L 2 
(Euclidean) norm. 

7. A unit vector with respect to a particular norm || • || is a vector that satis es the 
property that ||v|| = 1, and is sometimes denoted by v. 



2.5.6 DOT, SCALAR, OR INNER PRODUCT 

1 . The dot (or scalar or inner product) of two vectors of the same dimension, 
represented by v • u or v T u, has two common de nition s, depending upon the 
context in which this product is encountered. 

(a) In vector calculus and physics, the dot or scalar product is de ne d by 

v • u = ||v|| 1 1 u 1 1 cos#, (2.5.3) 
where 9 represents the angle between the vectors v and u. 
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(b) In optimization, linear algebra, and computer science, the inner product 
of two vectors, u and v, is equivalently de ned as 



U T V = 22 U i V i =UiV 1 -\ h U n V r , 



(2.5.4) 



i=l 



From the rst de nition , it is apparent that the inner product of two perpendic- 
ular, or orthogonal, vectors is zero, since the cosine of 90 ° is zero. 

2. The inner product of two parallel vectors (with u = rv) is given by v ■ u = 

1 1 1 1 2 

r ||v|| . For example, when r > 0, 

1 1 1 1 2 

v • u = ||v|| 1 1 u 1 1 cosO = ||v|| 1 1 u 1 1 = ||v|| ||rv|| = r ||v|| . (2.5.5) 

3. The dot product is distributive, e.g., 

(v + u) ■ w = v ■ w + u • w. (2.5.6) 

4. Forv,u, w e E" withn > 1, 

v T u = v T w u = w. (2.5.7) 
However, it is valid to conclude that 

v T u = v T w v T (u - w) = 0, (2.5.8) 
i.e., the vector v is orthogonal to the vector (u — w). 



FIGURE 2.1 

Depiction of right-hand rule. 



V-| x v 2 
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2.5.7 VECTOR OR CROSS PRODUCT 



1 . The vector (or cross product) of two non-zero three-dimensional vectors v and 
u is de ned as 

v x u = n ||v|| 1 1 u 1 1 sin#, (2.5.9) 

where n is the unit normal vector (i.e., vector perpendicular to both v and u) 
in the direction adhering to the right-hand rule (see Figure 2.1) and 6 is the 
angle between v and u. 

2. If v and u are parallel, then v x u = 0. 

3. The quantity ||v|| ||u|| |sin#| represents the area of the parallelogram deter- 
mined by v and u. 

4. The following rules apply for vector products: 



(7V) x (an) = ('ja)v x u, 

V X u = — U X V, 
vx (u + w) = vxu + vxw, 
(v + u) xw = vxw + uxw, 
v x (u x w) = u(w • v) — w(v • u), 
(v x u) • (w x z) = (v • w)(u • z) — (v • z)(u • w), 
(v x u) x (w x z) = [v • (u x z)]w - [v • (u x w)]z 
= [v • (w x z)]u — [u • (w x z)]v. 



(2.5.10) 



5. The pairwise cross products of the unit vectors i, j, and k, corresponding to the 
directions of v = v\i + v-2} + v^k, are given by 



i x j = -(j x i) =k, 
jxk = -(kxj) =i, 
k x i = — (i x k) = j, and 
ixi=jxj = kxk = 0. 



(2.5.11) 



6. If v = v\i + v-2j + V3k and u = uii + 112} + 113k, then 
i j k 

Vl V 2 V3 
U\ U 2 U3 

(V2U3 - U 2 V3)l + {V3U1 - U3Vi)i + {V1U2 ~ UiV 2 )k. 



(2.5.12) 
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2.5.8 SCALAR AND VECTOR TRIPLE PRODUCTS 



1 . The scalar triple product involving three three-dimensional vectors v, u, and 
w, sometimes denoted by [vuw] (not to be confused with a matrix containing 
three columns [v u w] ), can be computed using the determinant 



[vuw] = v • (u x w) = V ■ 



Vi 
Ui 

w 1 



U2 Uz 
W2 W 3 
Ul2 W3 



V 2 



Ul 


Uz 


W\ 


w 3 


U\ 


Uz 




w 3 



J + 

+ V 3 



Ul Ui 

W\ W2 

Ul Ui 

W\ U)2 



(2.5.13) 



u 



.\w\\ cos <p sin 0, 



where 8 is the angle between u and w, and <f> is the angle between v and the 
normal to the plane de ned by u and w. 

2. The absolute value of a triple scalar product calculates the volume of the par- 
allelepiped determined by the three vectors. The result is independent of the 
order in which the triple product is taken. 

3. (v x u) x (w x z) = [vwzju - [uwz]v = [vuz]w - [vuw]z. 

4. The vector triple product involving three three-dimensional vectors v, u, and 
w, given by v x (u x w), results in a vector, perpendicular to v, lying in the 
plane of u and w, and is de ned as 



v x (u x w) = (v • w)u — (v • u)w, 



Vi 



J 

V2 



k 



U2 


UZ 




Uz 


Ul 




Ul 


U2 


W 2 


W 3 




w 3 


Wi 




Wi 


W 2 



(2.5.14) 



5. Given three non-coplanar reference vectors v, u, and w, the reciprocal system 
is given by v* , u* , and w* , where 



U X w 
fvuwl ' 



W X v 
fvuwl ' 



w 



V X u 
fvuwl ' 



(2.5.15) 



Note that 



1* * * 

= V • V =u u = w w 

and = v • u* = v • w* = u • v* , etc. 



(2.5.16) 



The system i, j, k is its own reciprocal. 
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2.6 LINEAR AND MATRIX ALGEBRA 



2.6.1 DEFINITIONS 

1 . An mxn matrix is a two-dimensional array of numbers consisting of m rows 
and n columns. By convention, a matrix is denoted by a capital letter empha- 
sized with italics, as in A, B, D, or boldface, A, B, D. Sometimes a matrix 
has a subscript denoting the dimensions of the matrix, e.g., A 2X 3- If A is a 
real n x to matrix, then we write A € K" xm . Higher dimensional matrices, 
although less frequently encountered, are accommodated in a similar fashion, 
e.g., a three-dimensional matrix A mxnxp , and so on. 

2. A mxn is called rectangular if to ^ n. 

3. A mxn is called square if to = n. 

4. A particular component (equivalently: element) of a matrix is denoted by the 
lower-case letter of that which names the matrix, along with two subscripts 
corresponding to the row i and column j location of the component in the 
array, e.g., 

A m x „ has components a,j ; 
B m x „ has components b y . 

For example, 023 is the component in the second row and third column of 
matrix A. 

5. Any component a,j with i = j is called a diagonal component. 

6. The diagonal alignment of components in a matrix extending from the upper 
left to the lower right is called the principal or main diagonal. 

7. Any component a,j with i ^ j is called an off-diagonal component. 

8. Two matrices A and B are said to be equal if they have the same number of 
rows (to) and columns (n), and By = fry for all 1 < i < m, 1 < j < n. 

9. An to x 1 dimensional matrix is called a column vector. Similarly, a 1 x n 
dimensional matrix is called a row vector. 

10. A column (row) vector with all components equal to zero is called a null vector 
and is usually denoted by 0. 

11. A column vector with all components equal to one is often denoted by e. The 
analogous row vector is denoted by e T . 

12. The standard basis consists of the vectors {ei , e2 , . . . , e„} where e, is an n x 1 
vector of all zeros, except for the i th component, which is one. 
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13. The scalar x T x = ^7=1 x 1 ' s me sum °^ sc l uares °f a ^ components of the 
vector x. 

14. The weighted sum of squares is de ned by x T D w x = Wixf , when x has 
n components and the diagonal matrix D w is of dimension (n x n). 

15. If Q is a square matrix, then x T Qx is called a quadratic form. 

16. An n x n matrix A is called non-singular, or invertible, or regular, if there 
exists an n x n matrix £? such that AS = BA = I. The unique matrix B 
satisfying this condition is called the inverse of A, and is denoted by A -1 . 

17. The scalar x T y = Y17-1 x iVi> me mner product of x and y, is the sum of 
products of the components of x by those of y. 

18. The weighted sum of products is x T D w y = 53ILi WiXiyi, when x and y have 
n components, and the diagonal matrix D B is (n x n). 

19. The map x h-> x T Qy is called a bilinear form, where Q is a matrix of appro- 
priate dimension. 

20. The transpose of an m x n matrix A, denoted by A T , is an n x m matrix with 
rows and columns interchanged, so that the component of A is the (j, i) 
component of A J , and (A T )ji = (A)ij = a^. 

21. The Hermitian conjugate of a matrix A, denoted by A H , is obtained by trans- 
posing A and replacing each element by its complex conjugate. Hence, if 
am = um + ivki, then (A H ) k i = u tk - iv ik , with i = V^T. 

22. If Q is a square matrix, then the map x h-> x h Qx is called a Hermitian form. 



2.6.2 TYPES OF MATRICES 



1 . A square matrix with all components off the principal diagonal equal to zero 
is called a diagonal matrix, typically denoted by the letter D with a subscript 
indicating the typical element in the principal diagonal. 

EXAMPLE 

"an " 

D a = a 22 , D A 



an 











022 











033 



An 











A22 











A33 



2. A zero, or null, matrix is one whose elements are all zero (notation is "0"). 

3. The identity matrix, denoted by I, is the diagonal matrix with a^j = 1 for all 
i = j, and a,j = for i ^ j. The n x n identity matrix is denoted I n . 

4. The elementary matrix, Eij, is de ned differently in different contexts: 

(a) Elementary matrices have the form By = e,ej. Hence, A = 53 . a^E^ 
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(b) Elementary matrices are also written as E = I — auv J , where I is the 
identity matrix, a is a scalar, and u and v are vectors of the same dimen- 
sion. In this context, the elementary matrix is referred to as a rank-one 
modi ca tion of an identity matrix. 

(c) In Gaussian elimination, the matrix that subtracts a multiple I of row j 
from row i is called E^ = I — £e,ej, with l's on the diagonal and the 
number —i in row i column j. 

EXAMPLE 



E3 



5e 3 e[ : 



1 0' 
10 
-5010 
1 



5. A matrix with all components above the principal diagonal equal to zero is 
called a lower triangular matrix. 



EXAMPLE 



A- 



an 








an 


aii 





<231 


a3i 


033 



is lower triangular. 



6. A matrix with all components below the principal diagonal equal to zero is 
called an upper triangular matrix. (The transpose of a lower triangular matrix 
is an upper triangular matrix.) 

7. A matrix whose components are arranged in to rows and a single column is 
called a column matrix, or column vector, and is typically denoted using bold- 
face, lower-case letters, e.g., a and b. 

8. A matrix whose components are arranged in n columns and a single row is 
called a row matrix, or row vector, and is typically denoted as a transposed 
column vector, e.g., a T and b T . 

9. A square matrix is called symmetric if A = A J . 



10. A square matrix is called skew symmetric if A 1 



-A. 



11. A square matrix A is called Hermitian if A = A H . A square matrix A is called 
skew-Hermitian if A H = — A. All real symmetric matrices are Hermitian. 

12. A square matrix Q with orthonormal columns is said to be orthogonal. 1 It 
follows directly that the rows of Q must also be orthonormal, so that QQ T = 
Q T Q = I, or Q T = The determinant of an orthogonal matrix is ±1. 

A rotation matrix is an orthogonal matrix whose determinant is equal to +1. 

13. An to x n matrix A with orthonormal columns has the property A T A = I. 



1 Note the inconsistency in terminology that has persisted. 
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14. A square matrix is called unitary if A H A = I. A real unitary matrix is or- 
thogonal. The eigenvalues of a unitary matrix all have an absolute value of 
one. 

15. A square matrix is called a permutation matrix if its columns are a permutation 
of the columns of I. A permutation matrix is orthogonal. 

16. A square matrix is called idempotent if AA = A 2 = A. 

17. A square matrix is called a projection matrix if it is both Hermitian and idem- 
potent: A H = A 2 = A. 

18. A square matrix is called normal if A H A = AA H . The following matrices are 
normal: diagonal, Hermitian, unitary, skew-Hermitian. 

19. A square matrix is called nilpotent to index k if A k = but A k ~ l ^ 0. The 
eigenvalues of a nilpotent matrix are all zero. 

20. A principal sub-matrix of a symmetric matrix A is formed by deleting rows 
and columns of A simultaneously, e.g., row 1 and column 1; row 9 and column 
9, etc. 

21. A square matrix whose elements are constant along each diagonal is called a 
Toeplitz matrix. 



EXAMPLE 



A : 



a d e 
bad 
c b a 



and 



M 



4 

-11 
3 



1 
4 
-11 4 



(2.6.1) 



are Toeplitz matrices. Notice that Toeplitz matrices are symmetric about a 
diagonal extending from the upper right-hand corner element to the lower left- 
hand corner element. This type of symmetry is called persymmetry. 

22. A Vandermonde matrix is a square matrix V € ^ n+1 ' ,x ^ n+1 ' , in which each 
column contains unit increasing powers of a single matrix value: 



V 



- 1 


1 


Vl 


V2 






v\ 





1 



v (n+l) 
V (n+1) 



J (n+1) 



(2.6.2) 



23. A square matrix U is said to be in upper Hessenberg form if My =0 whenever 
i > j + An upper Hessenberg matrix is essentially an upper triangular matrix 
with an extra non-zero element immediately below the main diagonal entry in 
each column of U. For example, 



U 



Un U12 U13 Un 

&21 Uil U 2 3 U 2 A 

&32 W33 M34 

643 U44 



is upper Hessenberg. 
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24. If the sum of the components of each column of a matrix A € ffi nxn equals 
one, then A is called a Markov matrix. 

25. A circulant matrix is an n x n matrix of the form 



C 



c C\ 
c„-i c 

Cn-1 Cn-l 



Cl 



C2 



C2 
Cl 
CO 

C3 



C n -2 C„_i 
C n -3 C„_2 
Cn— 4 C n _3 



Cn-1 



CO 



(2.6.3) 



where the components Cy are such that (j — i) = k mod n have the same 
value Cfc. These components comprise the k th stripe of C. 

26. A matrix A = (ay ) has /ower bandwidth p if a,j = whenever i > j + p and 
upper bandwidth q if Oy = whenever j > i + q. When they are equal, they 
are the bandwidth of A. A diagonal matrix has bandwidth 0. A tridiagonal 
matrix has bandwidth 1 . An upper (resp. lower) triangular matrix has upper 
(resp. lower) bandwidth of n — 1 (resp. m — 1). 

[an ai2 ais 1 
a 2 i 0,11 a 23 then its x ed axis of 
«31 0,31 033 J 

rotation is given by v = i(a 2 3 - 032) + j( a 3i - 013) + k(ai 2 - 021)- 

28. A Householder transformation, or Householder re ection , is an n x n matrix 
H of the form H = I - (2uu T ) / (u T u), where the Householder vector n£l" 
is non-zero. 

29. A Givens rotation is de ned as a rank-two correction to the identity matrix 
given by 



G(i,k,6) 



1 











0' 



(2.6.4) 




k 



where c = cos# and s = sin 8 for some angle 8. Premultiplication by 
G(i, k, 8) T induces a counterclockwise rotation of 8 radians in the (i, k) plane. 
For x € K™ and y = G{i, k, 8) T x, the components of y are given by 



Xj, 



for j = i 
for j = k 
for j ^ i,k. 



(2.6.5) 
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2.6.3 CONFORMABILITY FOR ADDITION AND 
MULTIPLICATION 



1 . Two matrices A and B can be added (subtracted) if they are of the same di- 
mension. The result is a matrix of the same dimension. If C = A + B then 

Cij — Cli 



EXAMPLE 



A 2 



+ B 2 



3 2 

4 



+ 



"11 


-2 3" 




14 





2 ' 





1 1 




4 


1 


10 



2. Multiplication of a matrix or a vector by a scalar is achieved by multiplying 
each component by that scalar. If B = a A, then bij = acnj for all compo- 
nents. 

3. The matrix multiplication AB is de ned if the number of columns of A is 
equal to the number of rows of B. 

4. The multiplication of two matrices A mxn and B nxq results in a matrix C mxq 
whose components are de ne d as 



^ Clikbkj 



(2.6.6) 



A = l 



for i = 1,2, ... ,m and j = 1, 2, . . . , q. Each Cy is the result of the inner (dot) 
product of the i th row of A with the j th column of B. 



i th row of A 



j th column of B 



(ij) th element of C 



This rule applies similarly for matrix multiplication involving more than two 
matrices. If ABCD = E then 

eij = a ik b k ici m d mj . (2.6.7) 

k I m 

The second subscript for each matrix component must coincide with the rst 
subscript of the next one. 

EXAMPLE 

'2 -13 
-4 14 



-13 -5 10 
-46 18 31 
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5. In general, matrix multiplication is not commutative: AB ^ BA. 

6. Matrix multiplication is associative: A(BC) = (AB)C. 

7. The distributive law of multiplication and addition holds: C(A + B) = CA + 
CB and (A + B)C = AC + BC. 

8. Both the transpose operator and the Hermitian operator reverse the order of 
matrix multiplication: (ABC) T = C T B T A T and (ABC) H = C H B H A H . 



9. Strassen algorithm: The matrix product 
can be computed in the following way: 



an 


a\2 




foil fol2 




Cll 


Cl2 


p.7,1 


a 22 




&21 ^22 




C21 


C22_ 



TOl 


= (ai2 - 122) (&21 


+fo 22 ), 


Cll 


= mi + m 2 — TO4 + m% 


ni2 


= (an + 022) (foil 


+fo 22 ), 


C12 


= rri4 + m 5 , 


TO 3 


= (an - a 2 i)(&n 


+foi 2 ), 


C21 


= me + TO7, and 


T7l4 


= (an + ai 2 )fo22, 




C22 


= m 2 - m 3 + m, 5 - m 7 


TO 5 


= an(foi2 - 622), 








TO 6 


= a 22 (fo2i - foil), 








m-j 


= (a 2 i + a 22 )fon, 









This computation uses 7 multiplications and 18 additions and subtractions. 
Using this formula recursively allows multiplication of two n x n matrices 
using 0(n log2 7 ) = O(n 2 S07 - ) scalar multiplications. 

10. The order in which matrices are grouped together for multiplication can change 
the number of scalar multiplications required. The straightforward number 
of scalar multiplications required to multiply matrix X aX b by matrix Yj, xc is 
abc, without using clever algorithms such as Strassen's. For example, con- 
sider the matrix product P = Aioxioo-BiooxsCsxso- The parenthesization 
P = ((AB)C) requires (10 x 100 x 5) + (10 x 5 x 50) = 7,500 scalar 
multiplications. The parenthesization P = (A(BC)) requires (10 x 100 x 
50) + (100 x 5 x 50) = 75,000 scalar multiplications. 



11. Pre-multiplication by a diagonal matrix scales the rows 



dn 






d 22 







dnn a n i 



an 
a 2 i 



air 
a 2r 



dnan 
d 22 a 2 i 



d\\a\ r: 
d 22 a 2r; 



dnn&nl ' ' ' d nn Cl nr 



12. Post-multiplication by a diagonal matrix scales the columns 



an 
a 2 i 

a ra i 



air 
a 2r 



dn 
d 22 







dnan 
dna 2l 



0*11 a n i • • • d mm ci nr 
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2.6.4 DETERMINANTS AND PERMANENTS 

1. The determinant of a square matrix A, denoted by \A\ or det (A) or det A, is 
a scalar function of A de ned as 



det ( A) = det 



an a i2 

021 022 
dnl «n2 



din 
l2n 



an a i2 

021 022 
Clnl «n2 



air 
a 2r 



(2.6.8) 



= S 8' n ( Cr ) a l,CT(l) a 2, CT (2) • • • a n ,<7(n) 
a 

= ^ (— l) 5 ai«ia2j 2 ' ' ' a ni„ 
where the sum is taken either 

(a) over all permutations a of {1,2, ... ,n} and the signum function, sgn(<r), 
is (—1) raised to the power of the number of successive transpositions 
required to change the permutation a to the identity permutation; or 

(b) over all permutations i\ ^ ii ^ • • • ^ i n , and 5 denotes the number of 
transpositions necessary to bring the sequence (i i , i 2 , . . . , i„) back into 
the natural order (1,2, ... ,n). 



2. For a 2 x 2 matrix, | a a \\ a a \ 
For a 3 x 3 matrix, 



a\\ai2 — ai2d2i- 



an ai2 a\z 
an a-ii a-iz 
az\ 032 033 



a\\aiiazz + 012023031 + «i3«2i«32 



ai3a22d31 — O11O23O32 — «12«21«33- 



(2.6.9) 



3. The determinant of the identity matrix is one. 

4. Note that \A\ \B\ = \ AB\ and \A\ = \A T \. 

5. Interchanging two rows (or columns) of a matrix changes the sign of its 
determinant. 

6. A determinant does not change its value if a linear combination of other rows 
(or columns) is added to or subtracted from any given row (or column). 

7. Multiplying an entire row (or column) of A by a scalar 7 causes the determi- 
nant to be multiplied by the same scalar 7. 

8. For an n x n matrix A, Y)A\ = 7™|^4|. 

9. If det (A) = 0, then A is singular, if det (A) ^ 0, then A is non-singular or 
invertible. 
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10. det^" 1 ) = l/det(A). 



1 1 . When the edges of a parallelepiped P are de ned by the rows (or columns) 
of A, the absolute value of the determinant of A measures the volume of P. 
Thus, if any row (or column) of A is dependent upon another row (or column) 
of A, the determinant of A equals zero. 

12. The cofactor of a square matrix A, cof y (A), is the determinant of a sub-matrix 
obtained by striking the i th row and the j th column of A and choosing a positive 
(negative) sign if (i + j) is even (odd). 



EXAMPLE 



cof 2 . 



2 4 3 
6 1 5 
-2 13 



(-1) 



2+3 



"(2 + 8) 



-10. 



(2.6.10) 



13. Let By denote the components of A and a y those of A 1 . Then, 

a« =co£ji(A)/\A\. 



(2.6.11) 



14. Partitioning of determinants: Let A = [£^]. Assuming all inverses exist, 
then 



\A\ 



\E\ \(B -CE~ 1 D)\ = \B\ UE-DB^C)] 



(2.6.12) 



15. Laplace development: The determinant of A is a combination of row i (col- 
umn j) and the cofactors of row i (column j), i.e., 



\A\ = ancofii(A) + a i2 cof i2 (^4) H h a in cof in (A), 

= aijCofij(A) + a 2 jCof 2 jL4) + • • • + a n jCof n j(A), 

for any row i or any column j. 



(2.6.13) 



16. Omitting the signum function in Equation (2.6.8) yields the de nition of per- 
manent of A, given by per A = J2 a ai, CT (i) ■ ■ ■ a n ,a(n) ■ Properties of the per- 
manent include: 



(a) If A is an m x n matrix and B is an n x m matrix, then 
|per(AB)| 2 < per(AA H ) per(B H B). 



(2.6.14) 



(b) If P and Q are permutation matrices, then per PAQ = per A. 

(c) If D and G are diagonal matrices, then per DAG = per D per A per G. 
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2.6.5 MATRIX NORMS 

1. The mapping g : ffi mx " M is a matrix norm if g satis es the same three 
properties as a vector norm: 

(a) g(A) > for all A and g(A) = if and only if A = 0, so that (in norm 
notation) \\A\\ > for all non-zero A. 

(b) For two matrices A,B e M mx ™, g(A + B) < g(A) + g(B), so that 
\\A + B\\<\\A\\ + \\B\\. 

(c) g(rA) = \r\g(A), where r G ffi, so that H7J.U = [7 



2. The most common matrix norms are the L p matrix norm and the Frobenius 
norm. 

3. The L p norm of a matrix A is the number de ned by 



\Ax\\ 

sup ^yqP (2.6.15) 
lip 



x^O HXl 



where || • || represents one of the L p (vector) norms with p = 1, 2, or 00. 

(a) The L\ norm of A mxn is de ned as || A\\j = maxi<j<„ [fly [■ 

(b) The Li norm of A is the square root of the greatest eigenvalue of A T A, 
(i.e., IIJH2 = A max (J T J)), which is the same as the largest singular 
value of A, \\A\\ 2 = a^A). 

(c) The Loo norm is de ned as [[A^ = maxi<i< m J2j=i |oy|. 
4. The Frobenius or Hilbert-Schmidt norm of a matrix J is de ned as 

U\\ F 



\ «'=1 j=l 



which satis es [|A|[^, = tr(J T J). Since ffi mx ™ is isomorphic to K m ", the 
Frobenius norm can be interpreted as the L 2 norm of an nm x 1 column vector 
in which each column of A is appended to the next in succession. (See the 
Vector operation ("Vec") in Section 2.6.17.) 

5. When A is symmetric, then || A\\ 2 = m&xj \Xj\, where {Xj} are the eigenval- 
ues of A. 

6. The following properties hold: 

^||J|| 1 <||J|| 2 <v^||J|| 1 , 



rn 

max|ajj| < ||J|| 2 < y/mn max|ajj|, and (2 6 17) 



1 



-^PIIoo<Plla<Vm 
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7. The matrix p norms satisfy the additional property of consistency, de ne d as 
\\AB\\ p <\\A\\ p \\B\\ p . 

8. The Frobenius norm is compatible with the vector 2 norm, i.e., ||Ax|| F < 
\\A\\ F | |x| 1 2 . The Frobenius norm also satis es ||^4|| 2 < < \fn ||^4|| 2 . 



2.6.6 SINGULARITY, RANK, AND INVERSES 

1 . An n x n matrix A is called singular if there exists a vector x ^ such that 
Ax = or A T x = 0. (Note that x = means that all components of x are 
zero.) If a matrix is not singular, it is called non-singular. (This is consistent 
with note 16 on page 138.) 

2. (AB) -1 = B~ l A~ l , provided all inverses exist. 

3. (A~ 1 ) T = (A T )-\ 

4. (7A)- 1 = (lh)A-\ 

5. If D w is a diagonal matrix, then D" 1 = D Xl 



EXAMPLE If A, 



wn 

W22 



jw 
then D" 1 = 



/w 



ID11 





6. Partitioning: Let A = [ £ Assuming that all inverses exist, then A 1 
[§ £], where 

X = (B -CE~ l D)-\ U = {E-DB~ 1 C)-\ 
Y = -B^CU, Z = -E~ l DX. 

7. The inverse of a 2 x 2 matrix is as follows (de ned when ad ^ be): 

-l 



a b 
c d 



1 



ad — be 



d 



8. If A and B are both invertible, then 

(A + B)- 1 = B' 1 (A' 1 + B" 1 )" 1 A' 1 = A' 1 (A' 1 + B" 1 )" 1 B~\ 

(2.6.18) 

9. The row rank of a matrix A is de ned as the number of linearly independent 
rows of A. Likewise, the column rank equals the number of linearly indepen- 
dent columns of A. For any matrix, the row rank equals the column rank. 

10. If A G K" x ™ has rank of n, then A is said to have full rank. 

11. A square matrix is invertible if, and only if, it has full rank. 

12. Rank(AB) < min [rank( A) , rank(B)]. 

13. Rnnk(A T A) = rank(A4 T ) =rank(A). 
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2.6.7 SYSTEMS OF LINEAR EQUATIONS 



1. Suppose that A is a matrix. Then Ax = b is a system of linear equations. If A 
is square and non-singular, there exists a unique solution x = A _1 b. 

2. For the linear system of equations involving n variables and m equations, writ- 
ten as Ax = b or 

auxi + a V2 X2 H h a lm x m = b\ , 

a 2 \Xi + a-22X-2 H h a 2m s m = 62, 

(2.6.19) 

a„ixi + a n2 X2 H h a„ m x m = & n , 

the possible outcomes when searching for a solution are: 

(a) A unique solution exists, and the system is called consistent. 

(b) No such solution exists and the system is called inconsistent. 

(c) Multiple solutions exist, the system has an in nite number of solutions, 
and the system is called undetermined. 

3. The solvability cases of the linear systems Ax = b (when A is m x n) are: 

(a) If rank(A) = m = n, then there is a unique solution. 

(b) Ifrank(^L) = m < n, then there is an exact solution with free parameters. 

(c) If rank(A) = n < m, then either there is a unique solution, or there is a 
unique least-squares solution. 

(d) If rank(A) < m < n, or rank(A) < n < m, or rank(A) < n = m: 
then either there is an exact solution with free parameters, or there are 
non-unique least- squares solutions. 

4. If the system of equations Ax = b is undetermined, then we may nd the x 
that minimizes ||^4x — b|| for some p. 

EXAMPLE lfA=[l 1 l] T andb=[6i b 2 6 3 ] T with 61 > b 2 > b 3 > 
then the minimum of \\Ax — b\\ p in different norms is: 

P = 1 > Xoptimal = 62 

p = 2 — > Xopttaai = (61 +b 2 + b 3 )/3 (2.6.20) 

p= OO > Xoptimal = (6l + 63) /2 

5. For the system of linear equations Ax = b (with A square and non-singular), 
the sensitivity of the solution x to pertubations in A and b is given in terms of 
the condition number of A de ned by 

cond(A) = || A" 1 1| || A|| , (2.6.21) 
where ||-|| is any of the L p norms. In all cases, cond(A) > 1. 
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When cond(A) is equal to one, A is said to be perfectly conditioned. Matrices 
with small condition numbers are called well-conditioned. If cond(A) is large, 
then A is called ill-conditioned. 



6. For the system of equations (A + eF)x(e) = (b + ef), the solution satis es 

(2.6.22) 



llx(e) -x(0)|| „, / IIFII ||f||\ ^. 2 , 

ii,(o)ii ^ cond{A) ( e w\ +e m) + 0(6 } - 

7. When A is singular, the de nitio n of condition number is modi ed slightly, in- 
corporating the pseudo-inverse of A, and is de ned by cond( A) = \\A + \\ \\A\\ 
(see page 151). 

8. The size of the determinant of a square matrix A is not related to the condition 
number of A. For example, the n x n matrices below have K OQ (B n ) = n2 n ~ 1 
anddet(5„) = 1; n p {D n ) = 1 anddet(£>„) = 10"™. 



1 -1 

o 1 







D n =diag(10- 1 ,...,l(r 1 ). 



9. Let A = (dij) be an n x n matrix. Using the Li condition number, cond A 

maxj \\j(A)\ /minj \\i(A)\: 



Matrix A nxn = (ciy) 



A is orthogonal 

dij = V 2 /( n + !) sm(ij-K/(n + 1)) 
a,:j = nJjj + 1 

a,j = (i + j) /p, n = p — 1, p a prime 
The circulant whose rst row is (1, 2, . 

ji/j if i<j 

aij = < ... 

'-2 ifi = j 
1 if|i-j| = l 
.0 if \i-j\> 2 
2min(i,j) — 1 

(i + j - l) -1 (Hilbert matrix) 



,n) 



Condition number 



cond ( A) = 1 
cond (A) = 1 
cond (A) = 2 
cond (A) = \/n + 1 
cond (A) ~ n 

cond (A) ~ cn 1+€ , 
< e < 1 

cond (A) ~ 4n 2 /7r 2 

cond (A) ~ 16n 2 /7r 2 
log cond (A) ~ Kn, 
K « 3.5 



2.6.8 LINEAR SPACES AND LINEAR MAPPINGS 

1. Let R(A) and N(A) denote, respectively, the range space and null space of an 
to x n matrix A. They are de ned by: 

R(A) = {y | y = Ax; for some xfl"}, 
N(A) = {x G K" | Ax = 0} . 
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2. The projection matrix, onto a subspace S, denoted Ps, is the unique matrix 
possessing the three properties: 

(a) P s = Pj; 

(b) Pg = Ps (the projection matrix is idempotent); 

(c) The vector bs lies in the subspace S if, and only if, bs = Psv for some 
vector v. In other words, bs can be written as a linear combination of the 
columns of Ps. 

3. When the to x n matrix A (with n < m) has rank n, the projection of A onto 
the subspaces of A is given by: 

P R(A) = A(A T A) -1 A J , 

Pr(a^) = I, (2.6.24) 
P N(A r } =I-A(A T A)- 1 A\ 

When A is of rank to, the projection of A onto the subspaces of A is given by: 



Pr(A) = L 

Pr(at) = A T (AA T )- 1 A, (2.6.25) 
P N(A) =I-A T (AA T )- 1 A. 

4. When A is not of full rank, the matrix A A satis es the requirements for a 
projection matrix. The matrix A is the coef cient matrix of the system of 
equations x + = Ah, generated by the least-squares problem min 1 1 b — Ax \ | \ . 
Thus, 

Pr(a) = AA, 
Pr(a t ) = AA, 
Pn(A) = I-AA, 
P N (a?) = I-AA. 



(2.6.26) 



5. A matrix B G E. nxn is called similar to a matrix A e K" x ™ if B = T~ l AT 
for some non-singular matrix T. 

6. If B is similar to A, then B has the same eigenvalues as A. 

7. If B is similar to A and if x is an eigenvector of A, then y 
eigenvector of B corresponding to the same eigenvalue. 



2.6.9 TRACES 

1. The trace of an n x n matrix A, usually denoted as t?(A), is de ned as the 
sum of the n diagonal components of A. 
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2. The trace of an n x n matrix A equals the sum of the n eigenvalues of A, i.e., 
tr A = an + a-ii + ■ ■ ■ + a nn = Ai + A2 + • • • + A„. 

3. The trace of a 1 x 1 matrix, a scalar, is itself. 

4. If A G WL mxk and£ G ffi* xm , then tr(AB) = tr(5A). 

5. If A G M mxfc , B G IS** 1 ", and C G K rxm , then tr (ABC) = tr(BCA) = 
tr(CAB). For example, if B = b is a column vector and C = c T is a row 
vector, thentr(Abc T ) = tr(bc T A) = tr(c T Ab). 

6. tx(A + 7-B) = tr(^4) + 7tr(B), where 7 is a scalar. 

7. tr(i4B) = (Vec A T ) T Vec S (see Section 2.6. 17 for the "Vec" operation) 



2.6.10 GENERALIZED INVERSES 

1 . Every matrix A (singular or non-singular, rectangular or square) has a general- 
ized inverse, or pseudo-inverse, A + de ned by the Moore-Penrose conditions: 

AA + A = A, 
A+AA+ = A+, 

(2.6.27) 

(AA+) T = AA+, 
(A + A) T = A + A. 

There is a unique pseudo-inverse satisfying the conditions in (2.6.27). 

2. If, and only if, A is square and non-singular, then A + = A -1 . 

3. For a square singular matrix A, AA + ^ J, and A + A ^ I. 

4. The pseudo-inverse is the unique solution to min \\AX — I m \\ F . 

5. The least-squares problem is to nd the x that minimizes ||y — ^4x|| 2 . The x of 
least norm is x = A + y. 

6. If A is a rectangular m x n matrix of rank n, with m > n, then A + is of order 
n x m and A + A = I G K nx ™. In this case A + is called a left inverse, and 
AA+ ^ I. 

7. If A is a rectangular mxn matrix of rank m, with m < n, then A + is of order 
n x m and AA + = I G K mxm . In this case A + is called a Wg/if inverse, and 
A+A ^ J. 

8. The matrices AA + and A + A are idempotent. 
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9. Computing the pseudo-inverse: The pseudo-inverse of A mxn can be deter- 
mined by the singular value decomposition A = UT,V T . If A has rank r > 0, 
then S mx „ has r positive singular values (<r,) along the main diagonal extend- 
ing from the upper left-hand corner and the remaining components of £ are 
zero. Then A+ = (VEV T ) + = (V T )+'E + U + = VE+U T since (V T )+ = V 
and U + = U T because of their orthogonality. The components of in £+ are 




ifffj ^0; 
if a,- = 0. 



(2.6.28) 



10. The pseudo-inverse is ill-conditioned with respect to rank-changing perturba- 
tions. For example: 





1 


-1" 


+ e 


1 


0" 




( 


2 


-2 





2 


) 



1 
1 

10 



-1 


1 


1 


1 


o" 




2 
1 

2 


+ - 




i 

2. 


-1 


e 






1 2 

-1 -2 



e^0, 



e = 0. 



(Note that the pseudo-inverse is the same as the inverse when e ^ 0.) 



EXAMPLE If A . 



1111' 
1111 
1111 



then A + = — 



1 1 1' 
111 
111 
111 



2.6.11 EIGENSTRUCTURE 

1. If A is a square n x n matrix, then the n th degree polynomial de ned by 
det (A — XI) = is called the characteristic polynomial, or characteristic 
equation of A. 

2. The n roots (not necessarily distinct) of the characteristic polynomial are called 
the eigenvalues (or characteristic roots) of A. Therefore, the values, A,, i = 
1, . . . , n, are eigenvalues if, and only if, \ A — A,/| = 0. 

3. The characteristic polynomial det (A — XI) = 2~^™=o r *^* nas me properties 

Tn = ("I)", 

r n -i = ~r n tr(A), 

r n -2 = ~\ [r„_i tr{A) + r n tr(A 2 )] , 

r n -3 = ~ [r„_2 tr(A) + r„_i tr(A 2 ) + r n tr(A 3 )] , 



ro 



1 

n 



J2r P tr(A") 
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4. Each eigenvalue A has a corresponding eigenvector x (different from 0) that 
solves the system Ax = Ax, or (A — XI)x = 0. 

5. If x solves Ax = Ax, then so does 7X, where 7 is an arbitrary scalar. 

6. Cayley-Hamilton theorem: Any matrix A satis es its own characteristic 
equation. That is Y^=o r i^ t = 0- 

7. The eigenvalues of a triangular (or diagonal) matrix are the diagonal compo- 
nents of the matrix. 

8. The eigenvalues of idempotent matrices are zeros and ones. 

9. If A is a real matrix with positive eigenvalues, then 

A min (A4 T ) < [X min (A)} 2 < IKzM)} 2 < A max (A4 T ), (2.6.29) 
where A m ; n denotes the smallest and A max the largest eigenvalue. 

10. If all the eigenvalues of a real symmetric matrix are distinct, then their associ- 
ated eigenvectors are also distinct (linearly independent). 

11. Real symmetric and Hermitian matrices have real eigenvalues. 

12. The determinant of a matrix is equal to the product of the eigenvalues. That is, 
if A has the eigenvalues Ai , A2, . . . , A„, then det (A) = \ 1 \ 2 ■ ■ ■ A„. 

13. The following table shows the eigenvalues of speci c matrices 



matrix 


eigenvalues 


diagonal matrix 

upper or lower triangular 

A is n x n and nilpotent 

Aisnxn and idempotent of rank r 

(a — b)I„ + b.J„, where J n is the 
n x n matrix of all l's 


diagonal elements 
diagonal elements 

(n times) 

1 (r times); and (n — r times) 

a + (n — 1)6; and a — b (n — 1 
times) 



14. Let A have the eigenvalues {Ai , A2 , . . . , A„}. The eigenvalues of some func- 
tions of A are shown below: 



matrix 


eigenvalues 


A T 
A H 

A k , k an integer 

A~ k , k an integer, A non-singular 

q(A), q is a polynomial 

SAS -1 , S non-singular 

AB, where A is m x n, B is 
n x to, and m > n 


eigenvalues of A 

complex conjugates of {X k , A* , . . . , A*} 
{At,A§,...,A*} 
{Aj k ,X 2 k ,. . . ,X~ k } 
{ q (\ k ),q(\ k ),...,q(\ k )} 
eigenvalues of A 

eigenvalues of BA; and (to — n times) 
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2.6.12 MATRIX Dl AGON ALIZATION 



1. If A £ M nxn possesses n linearly independent eigenvectors Xi, . . . , x„, then 
A can be diagonalized as S~ 1 AS = A = diag(Ai , . . . , A„), where the eigen- 
vectors of A are chosen to comprise the columns of S. 



If A £ W nxn can be diagonalized into S^AS = A, then A k = SA k S~ 
A k = S~ 1 A k S. 



3. 



\ or 



Spectral decomposition: Any real symmetric matrix A £ K raxn can be diago- 
nalized into the form A = U AU T , where A is the diagonal matrix of ordered 
eigenvalues of A such that Ai > A2 > • • • > A„, and the columns of U are the 
corresponding n orthonormal eigenvectors of A. 

That is, if A £ E" x ™ is symmetric, then a real orthogonal matrix Q exists 
such that Q T AQ = diag(Ai , . . . , A„). 

4. The spectral radius of a real symmetric matrix A, commonly denoted by p( A) , 
is de ned as p(A) = maxi<,<„ |A,(A)|. 

5. If A £ ffi" x ™ and B £ E" x ™ are diagonalizable, then they share a common 
eigenvector matrix S if and only if AB = BA. (Not every eigenvector of A 
need be an eigenvector for B, e.g., the above equation is always true if A = I.) 

6. Schur decomposition: If A £ C" x ™, then a unitary matrix Q £ C" x ™ exists 
such that Q n AQ = D + N, where D = diag(Ai , . . . , A„) and N £ C" x ™ is 
strictly upper triangular. The matrix Q can be chosen so that the eigenvalues 
A, appear in any order along the diagonal. 

7. If A £ E" x ™ possesses s < n linearly independent eigenvectors, it is similar 
to a matrix with s Jordan blocks (for some matrix M) 



J = M~ l AM 











J, 



where each Jordan block J, is an upper triangular matrix with (a) the single 
eigenvalue A, repeated n, times along the main diagonal; (b) (rij — 1) l's 
appearing above the diagonal entries; and (c) all other components zero: 



A,; 1 



01 







(2.6.30) 
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2.6.13 MATRIX EXPONENTIALS 

1. Matrix exponentiation is de ned as (the series always converges): 

e M = I + Ai + ^_ + ^_ + ... m (2.6.31) 

2. Common properties of matrix exponentials are: 

(a) (e As ) (e At ) = e A{s+t \ 

(b) (e At ) (e- At ) = I, 

(c) f t e At = Ae At , 

(d) When A and B are square matrices, the commutator of A and B is C = 
[B, A] = BA - AB. Then e {A+B ^ = e A e B e c / 2 provided that [C, A] = 
[C, B] = (i.e., each of A and B commute with their commutator). In 
particular, if A and B commute then e A+B = e A e B . 

3. For a matrix A € K" x ™, the determinant of e At is given by: 

det (e At ) = e Ali e A2i • • • e A " 4 = e tr ^ . (2.6.32) 

4. The diagonalization of e^ 1 *, when A is diagonalizable, is given by e At = 
Se Dt S~ 1 where the columns of S consist of the eigenvectors of A, and the 
entries of the diagonal matrix D are the corresponding eigenvalues of A, that 
is, A = SDS-\ 



2.6.14 QUADRATIC FORMS 

1 . For a symmetric matrix A, the map xi->x T ix is called a pure quadratic form. 
It has the form 

n n 

x T Ax = ^2 ~^2aijXiXj = a\\x\ + a\2X\x-2 + 021^2^1 + • • • + a nn x\. 

i=l j=l 

(2.6.33) 

2. For A symmetric, the gradient of x T Ax/x T x equals zero if, and only if, x is 
an eigenvector of A. Thus, the stationary values of this function (where the 
gradient vanishes) are the eigenvalues of A. 

3. The ratio of two quadratic forms (B non-singular) u(x) = (x 1 Ax) j (x T Bx) 
attains stationary values at the eigenvalues of B~ l A. In particular, 

"mm = A max (-B 1 A), and Umin = A m ; n (-B 1 A) . 

4. A matrix A is positive de n ite if x T Ax > for all x ^ 0. 
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5. A matrix A is positive semi-de n ite if x T Ax > for all x. 

6. For a real, symmetric matrix A € K™ x ™, the following are necessary and 
suf cien t conditions to establish the positive de niteness of A: 

(a) All eigenvalues of A have Aj > 0, for i = 1, . . . , n, and 

(b) The upper-left sub-matrices of A, called the principal sub-matrices, de- 
ned by A\ = [an] , 

an ai2 • • • ain 

021 022 • • • a2« 
Q>nl Q>n2 ' ' ' ®>nn 

have det(Ak) > 0, for all k = 1, . . . , n. 

7. If ^4 is positive de nite, then all of the principal sub-matrices of A are also 
positive de nite. Additionally, all diagonal entries of A are positive. 

8. For a real, symmetric matrix A € K" x ™, the following are necessary and 
suf cien t conditions to establish the positive semi-de niten ess of A: 

(a) All eigenvalues of A have Aj > 0, for i = 1, . . . , n, 

(b) The principal sub-matrices of A have det Af. > 0, for all k = 1, . . . , n. 

9. If A is positive semi-de nite, then all of the principal sub-matrices of A are 
also positive semi-de nite. Additionally, all diagonal entries of A are non- 
negative. 

10. If the matrix Q is positive de nite, then (x T — Xq)(2 _1 (x — x ) = 1 is the 
equation of an ellipsoid with its center at xj. The lengths of the semiaxes are 
equal to the square roots of the eigenvalues of Q; see page 330. 



an ai2 

021 Cl22 



2.6.15 MATRIX FACTORIZATIONS 

1. Singular value decomposition (SVD): Any m x n matrix A can be written as 
the product A = UT,V T , where U is an m x m orthogonal matrix, V is an 
nxn orthogonal matrix, and E = diag((Ti , <r 2 , ■ ■ ■ , & P ), with p = min (to, n) 
and <ti > (T2 > • • • > o p > 0. The values <r,, i = 1, . . . ,p, are called the 
singular values of A. 

(a) When rank(A) = r > 0, A has exactly r positive singular values, and 
0>+i = ■ ■ ■ = <t p = 0. 

(b) When A is a symmetric nxn matrix, then o\ = |Ai | , . . . , a n = |A n |, 
where Ai , A2 , . . . , A„ are the eigenvalues of A. 
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(c) When A is an to x n matrix, if to > n then the singular values of A 
are the square roots of the eigenvalues of A T A. Otherwise, they are the 
square roots of the eigenvalues of AA T . 

2. Any non-singular mxn matrix A of maximal rank can be factored as PA = 
LU, where P is a permutation matrix, L is lower triangular, and U is upper 
triangular. 

3. QR factorization: If all the columns of A € K mx ™ are linearly independent, 
then A can be factored as A = QR, where Q £ jjmx« jj as orthonormal 
columns and R € ffi nxn is upper triangular and non-singular. 

4. If A £ E" x ™ is symmetric positive de nite, then 

A = LDL 1 = LD 1/2 D 1/2 L T = (lD 1/2 ^J (l£> 1/2 ) = GG T (2.6.34) 

where L is a lower triangular matrix and D is a diagonal matrix. The factor- 
ization A = GG T is called the Cholesky factorization, and the matrix G is 
commonly referred to as the Cholesky triangle. 



2.6.16 THEOREMS 

1. Frobenius-Perron theorem: If A > (i.e., A is positive de nite), then there 
exists a A > and x > such that 

(a) Ax = A x , 

(b) if A is any other eigenvalue of A, A ^ Ao, then |A| < Ao, and 

(c) Ao is an eigenvalue with geometric and algebraic multiplicity equal to 
one. 

2. If A > 0, and A k > for some positive integer k, then the results of the 
Frobenius-Perron theorem apply to A. 

3. Courant-Fischer minimax theorem: If A i {A) denotes the i lh largest eigenvalue 
of a matrix A = A T € E" x ™, then 

Ax 

XAA)=m&x min — = — j = l,...,n (2.6.35) 
where x£l° and Sj is a j -dimensional subspace. 

From this follows Raleigh's principle: The quotient R(x) = x T Ax/x T x is 
minimized by the eigenvector x = Xi corresponding to the smallest eigenvalue 
Ai of A. The minimum of R(x) is Ai, that is, 

x T Ax xlAxi xTAiXi 

mini?(x) = min — = — = R(xi) = — = — = — = — = Ai. (2.6.36) 
x'x xjx xix 
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4. Cramer's rule: The j th component of x = A J b is given by 



det Bj 



where 



3 ~ AetA ' 

an ai2 • • • a i,j-i h ■ ■ ■ air 



&n,j — l b n Cl n j+\ 



(2.6.37) 



The vector b = [foi ... b n ] T replaces the j th column of the matrix A to 
form the matrix Bj . 

5. Sylvester's law of inertia: For a symmetric matrix A € K™ x ™, the matrices A 
and C T AC, for C non-singular, have the same number of positive, negative, 
and zero eigenvalues. 

6. Gerschgorin circle theorem: Each eigenvalue of an arbitrary n x n matrix 
A = (ciij) lies in at least one of the circles {C\ , C2, . . . , C„} in the complex 

n 

plane, where circle Cj has center a,, and radius given by p, = ^ |. 

j'=i 



2.6.17 THE VECTOR OPERATION 

The matrix A mxn can be represented as a collection of to x 1 column vectors: A - 
[ai &2 ... a„] . De ne Vec A as the matrix of size nm x 1 (i.e., a vector) by 



VecA 



(2.6.38) 



This operator has the following properties: 

1. tr AB = (Vec4 T ) T VecB. 

2. The permutation matrix U that associates Vec X and Vec X T (that is, Vec X J = 
U Vec X) is given by: 

U = [Vec E n Vec E\ x ... Vec E T nl ] = ^ £ rs ® Ej s . (2.6.39) 



3. Vec(^yB) = (B T (g) A) Vec F. 

4. If A and 5 are both of size n x n, then 

(a) Vec = (/„ ® A) Vec B. 

(b) Vec AB = (B T ® A) Vec /„. 
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2.6.18 KRONECKER PRODUCTS 

If the matrix A = (ay) has size to x n, and the matrix B = (bij) has size r x s, 
then the Kronecker product (sometimes called the tensor product) of these matrices, 
denoted A ® B, is de ned as the partitioned matrix 



a\\B a\iB 
ai\B (122B 

A® B = 

_a m \B a m iB 
Hence, the matrix A® B has size mr x ns. 



a\ n B 

Cl2 n B 

B 



EXAMPLE UA = 


an aii 


andB = 


611 612 


, then 








0,21 022 






621 622 
















011611 


011612 


012611 


012612 


A®B = 


auB 


ai 2 B 






011621 


011622 


012621 


012622 


0,21 B 


022S 






021611 


021612 


022611 


022612 












021621 


021622 


022621 


022622 



(2.6.40) 



(2.6.41) 



The Kronecker product has the following properties: 

1 . If z and w are vectors of appropriate dimensions, then 
Az ® Bw = (A ® B)(z ® w). 

2. If a is a scalar, then (aA) ® B = A ® (aS) = a(A ® B). 

3. The Kronecker product is distributive with respect to addition: 

(a) (A + B)®C = A®C + B®C, and 

(b) A®(B + C) = A®B + A®C. 

4. The Kronecker product is associative: A <S> (B <S> C) = (A <S> B) <S> C . 

5. (A (g) B) T = A T (g) B T . 

6. The mixed product rule: If the dimensions of the matrices are such that the 
following expressions exist, then (A <S> B)(C ® D) = AC ® BD. 

7. If the inverses exist, then (A ® B) -1 = A' 1 ® B~ l . 

8. If {A,} and {x,} are the eigenvalues and the corresponding eigenvectors for 
A, and {pj} and {y^} are the eigenvalues and the corresponding eigenvectors 
for B, then A® B has eigenvalues {Xi^j} with corresponding eigenvectors 

{xj ®yj}- 

9. If matrix A has size n x n and B has size m x to, then det(A ® B) = 
(det A) m (detB) n . 



10. If / is an analytic matrix function and A has size n x n, then 
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(a) /(I„® A) = J„® I '(A), and 

(b) /(A® J„) =/(i)®7„. 

11. tt(A®B) = (tr^)(trB). 

12. If A, B, C, and D are matrices with A similar to C and B similar to D, then 
A ® B is similar to C ® D. 

13. If C(t) = A(t) ® fl(t), then ^£ = #85 + 4® M. 



2.6.19 KRONECKER SUMS 

If the matrix A = (oy) has size n x n and matrix _B = (fey) has size m x m, then 
the Kronecker sum of these matrices, denoted A ffi B, is de ned 2 as 

A®B = A®I m + I n ®B. (2.6.42) 

The Kronecker sum has the following properties: 

1. If A has eigenvalues {A,} and B has eigenvalues {/ij}, then A® B has eigen- 
values {A, -I- 

2. The matrix equation AX + X B = C may be equivalently written as 
(B T © A) YecX = Vec C, where Vec is de ned in Section 2.6.17. 

3. e A(SB =e A ®e B . 



2.7 ABSTRACT ALGEBRA 



2.7.1 DEFINITIONS 

1 . A binary operation on a set S is a function * : S x S S. 

2. An algebraic structure (S, *i, . . . , *„) consists of a non-empty set S with one 
or more binary operations de ned on S. If the operations are understood, 
then the binary operations need not be mentioned explicitly. 

3. The order of an algebraic structure S is the number of elements in S, written 
\S\. 

2 Note that A © B is also used to denote the (m + n) X (m + n) matrix ^ j' . 
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4. A binary operation ★ on an algebraic structure (S, ★) may have the following 
properties: 

(a) Associative: a* (b* c) = (a*b) * c for all a,b,c G S. 

(b) Identity: there exists an element e G S (identity element of 5) such that 
e ★ a = a ★ e = a for all a G S. 

(c) Inverse: a -1 G 5 is an inverse of a if a ★ a -1 = a -1 ★ a = e. 

(d) Commutative (or abelian): if a ★ fo = 6 * a for all a, 6 G 5. 

5. A semigroup (£,*) consists of a non-empty set 5 and an associative binary 
operation ★ on S. 

6. A monoid (S, ★) consists of a non-empty set S with an identity element and 
an associative binary operation *. 

2.7.1 .1 Examples of semigroups and monoids 

1. The sets N = {0, 1, 2,3,.. .} (natural numbers), Z = {0, ±1, ±2, . . . } (in- 
tegers), Q (rational numbers), E (real numbers), and C (complex numbers) 
where ★ is either addition or multiplication are semigroups and monoids. 

2. The set of positive integers under addition is a semigroup but not a monoid. 

3. If A is any non-empty set, then the set of all functions / : A — > A where ★ is 
the composition of functions is a semigroup and a monoid. 

4. Given a set S, the set of all strings of elements of S, where ★ is concatenation 
of strings, is a monoid (the identity is A, the empty string). 



2.7.2 GROUPS 

1 . A group (G, ★) consists of a set G with a binary operation ★ de ned on G such 
that ★ satis es the associative, identity, and inverse laws. Note: The operation 
★ is often written as + (an additive group) or as • or x (a multiplicative group). 

(a) If + is used, the identity is written and the inverse of a is written —a. 
Usually, in this case, the group is commutative. The following notation 
is then used: na = a + . . . + a . 

n times 

(b) If multiplicative notation is used, a * b is often written ab, the identity is 
often written 1, and the inverse of a is written a -1 . 

2. The order of a G G is the smallest positive integer n such that a n = 1 where 
a n = a ■ a - ■ - a in times) (or a + a + ■ ■ ■ + a = if G is written additively). 
If there is no such integer, the element has in nite order. In a nite group of 
order n, each element has some order k (depending on the particular element) 
and it must be that k divides n. 

3. (H, ★) is a subgroup of (G, ★) if H C G and (H, ★) is a group (using the same 
binary operation as in (G,*)). 
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4. The cyclic subgroup (a) generated by a € G is the subgroup {a n \ n € Z} = 
{. . . , a~ 2 = (a -1 ) 2 , a -1 , a = e, a, a 2 , . . .}. The element a is a generator of 
(a). A group G is cvc//c if there is a € G such that G = (a). 

5. If 7? is a subgroup of a group G, then a left [right] coset of H in G is the set 
aH = {ah\h£H} [Ha = {ha | h G #}] . 

6. A normal subgroup of a group G is a subgroup H such that ai? = Ha for all 
a £ G. 

7. A simple group is a group G ^ {e} with only G and {e} as normal subgroups. 

8. If H is a normal subgroup of G, then the quotient group (or factor group) of 
G modulo H is the group G/H = {aH \ a € G}, with binary operation 
aH ■ bH = (ab)H. 

9. A nite group G is solvable if there is a sequence of subgroups G i , Gi, ■ ■ ., 
Gfc, with Gi = G and G& = {e}, such that each Gj+i is a normal subgroup 
of Gi and Gj/Gj+i is abelian. 

2.7.2.1 Facts about groups 

1 . The identity element is unique. 

2. Each element has exactly one inverse. 

3. Each of the equations a * x = b and x * a = b has exactly one solution, 
x = a -1 *b and x = b * a -1 . 

4. (a" 1 )" 1 = a. 

5. (a + b)- 1 = b~ l *a-\ 

6. The left (respectively right) cancellation law holds in all groups: If a*b = a*c 
then b = c (respectively, if6*a = c*a then b = c). 

7. Lagrange's theorem: If G is a nite group and H is a subgroup of G, then the 
order of H divides the order of G. 

8. Every group of prime order is abelian and hence simple. 

9. Every cyclic group is abelian. 

10. Every abelian group is solvable. 

11. Feit-Thompson theorem: All groups of odd order are solvable. Hence, all 
nite non- Abelian simple groups have even order. 

12. Finite simple groups are of the following types: 

(a) Z p (p prime) 

(b) A group of Lie type 

(c) A n (n > 5) 

(d) Sporadic groups (see table on page 191) 
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2.7.2.2 Examples of groups 

1 . Z, Q, R, and C, with ★ the addition of numbers, are additive groups. 

2. For n a positive integer, nZ = {nz | z £ Z} is an additive group. 

3. Q - {0} = Q*, E - {0} = ffi*, C — {0} = C*, with * the multiplication of 
numbers, are multiplicative groups. 

4. Z„ = Z/nZ = {0, 1, 2, ... ,n — 1} is a group where * is addition modulo n. 

5. Z* = {fc | fc G Z„, A: has a multiplicative inverse (under multiplication mod- 
ulo n) in Z„ } is a group under multiplication modulo n. If p is prime, Z * is 
cyclic. If p is prime and a G Z* has order (index) p — 1, then a is a primitive 
root modulo p. See the tables on pages 192 and 193 for power residues and 
primitive roots. 

6. If (Gi,*i), (G 2 ,*2), ■ ■ ■ , (G n ,* n ) are groups, the (direct) product group is 
(Gi x G 2 x • • • x G„,*) = {(ai,a 2 , • ■-,««) | a t G Gj,« = 1,2, ... ,n} 
where * is de ne d by 

(01,02, ... ,a n ) * (61,62,. . . , 6„) = (ai *i b\, a 2 *2 6 2 , . . . , a„ *„ 6„). 

7. All m x n matrices with real entries form a group under addition of matrices. 

8. All n x n matrices with real entries and non-zero determinants form a group 
under matrix multiplication. 

9. All 1—1, onto functions / : S — > S (permutations of S), where S is any non- 
empty set, form a group under composition of functions. See Section 2.7.9. 

In particular, ifS = {l,2,3,...,n}, the group of permutations of 5" is called 
the symmetric group, S n . In S n , each permutation can be written as a prod- 
uct of cycles. A cycle is a permutation a = (i\ ii ■ ■ ■ iu), where a(i\) = 
*2)f fe) = *3, • • • , &(ik) = i\- Each cycle of length greater than 1 can be 
written as a product of transpositions (cycles of length 2). A permutation is 
even (odd) if it can be written as the product of an even (odd) number of 
transpositions. (Every permutation is either even or odd.) The set of all even 
permutations in S n is a normal subgroup, A n , of S n . The group A n is called 
the alternating group on n elements. 

10. Given a regular polygon, the dihedral group D „ is the group of all symme- 
tries of the polygon, that is, the group composed of the set of all rotations 
around the center of the polygon through angles of 360k /n degrees (where 
k = 0, 1, 2, . . . ,n — 1), together with all re ections in lines passing through 
a vertex and the center of the polygongon, using composition of functions. 
Alternately, D n = {a i b j \ i = 0, 1; 3 = 0, 1, . . . ,n - 1; aba' 1 = 6" 1 }. 
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2.7.3 RINGS 



2.7.3.1 De nitions 

1. A ring (R, +, •) consists of a non-empty set R and two binary operations, + 
and •, such that (R, +) is an abelian group, the operation • is associative, and 
the left distributive law a(b + c) = (ab) + (ac) and the right distributive law 
(a + b)c= (ac) + (be) hold for all a,b,c£ R. 

2. A subset 5 of a ring R is a subring of R if S is a ring using the same operations 
used in R with the same unit. 

3. A ring R is a commutative ring if the multiplication operation is commutative: 
ab = ba for all a, b € R. 

4. A ring R (with R ^ {0}) is a ring with unity if there is an element 1 (called 
unity) such that al = la = a for all a € R. 

5. A unit in a ring with unity is an element a with a multiplicative inverse a -1 
(that is, aa _1 = a _1 a = 1). 

6. If a ^ 0, b ^ 0, and a& = 0, then a is a /e/j divisor of zero and 6 is a Wg/if 
divisor of zero. 

7. A subset 7 of a ring (R, +, ■) is a (two-sided) /cfea/ of 7? if (7, +) is a subgroup 
of (7?, +) and 7 is closed under left and right multiplication by elements of 7? 
(if x € 7 and r £ R, then rx € 7 and a;r € 7). 

8. An ideal 7 C 7? is 

(a) Proper: if 7 ^ {0} and 7 ^ 7? 

(b) Maximal: if 7 is proper and if there is no proper ideal properly contain- 
ing 7 

(c) Prime: if ab € 7 implies that a or 6 G 7 

(d) Principal: if there is a € 7? such that 7 is the intersection of all ideals 
containing a. 

9. If 7 is an ideal in a ring 7?, then a coset is a set r + 7 = {r + a \ a e 7}. 

10. If 7 is an ideal in a ring 7?, then the quotient ring is the ring 7?/7 = {r + I \ 
r £ R}, where (r + 1) + (s + 1) = (r + s) + 1 and (r + 7) (s + 1) = (rs) + 1. 

1 1. An integral domain (R, +, ■) is a commutative ring with unity such that can- 
cellations hold: if ab = ac then b = c (respectively, if ba = ca then b = c) 
for all a, b, c £ 7?, where a ^ 0. (Equivalently, an integral domain is a 
commutative ring with unity that has no divisors of zero.) 

12. If 7? is an integral domain, then a non-zero element r € 7? that is not a unit is 
irreducible if r = ab implies that either a or b is a unit. 
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13. If R is an integral domain, a non-zero element r € R that is not a unit is 
a prime if, whenever r|afo, then either r\a or r\b (x\y means that there is an 
element z € R such that y = zx.). 

14. A unique factorization domain (UFD) is an integral domain such that every 
non-zero element that is not a unit can be written uniquely as the product of 
irreducible elements (except for factors that are units and except for the order 
in which the factor appears). 

15. A principal ideal domain (PID) is an integral domain in which every ideal is a 
principal ideal. 

16. A division ring is a ring in which every non-zero element has a multiplicative 
inverse (that is, every non-zero element is a unit). (Equivalently, a division 
ring is a ring in which the non-zero elements form a multiplicative group.) A 
non-commutative division ring is called a skew eld . 

2.7.3.2 Facts about rings 

1 . The set of all units of a ring is a group under the multiplication de ned on the 
ring. 

2. Every principal ideal domain is a unique factorization domain. 

3. If R is a commutative ring with unity, then every maximal ideal is a prime 
ideal. 

4. If R is a commutative ring with unity, then R is a eld if and only if the only 
ideals of R are R and {0}. 

5. If R is a commutative ring with unity and / ^ R is an ideal, then R/I is an 
integral domain if and only if / is a prime ideal. 

6. If R is a commutative ring with unity, then 7 is a maximal ideal if and only if 
R/I is a eld. 

7. If f(x) £ F[x] (where F is a eld) and the ideal generated by f(x) is not {0}, 
then the ideal is maximal if and only if f(x) is irreducible over F. 

8. There are exactly four normed division rings; they have dimensions 1, 2, 4, 
and 8. They are the real numbers, the complex numbers, the quaternions, and 
the octonions. The quaternions are non- commutative and the octonions are 
non-associative. 

2.7.3.3 Examples of rings 

1. Z (integers), Q (rational numbers), E (real numbers), and C (complex num- 
bers) are rings, with ordinary addition and multiplication of numbers. 
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2. Z„ is a ring, with addition and multiplication modulo n. 

3. If \fn is not an integer, then Z[^/n\ = {a + b^/n \ a, b G Z}, where (a + 
b^Jn) + (c + d\fn) = (a + c) + (b + d)\fn and (a + b^/n)(c + d\fn) = 
(ac + nbd) + (ad + bc)y/n is a ring. 

4. The set of Gaussian integers Z[i] = {a + bi \ a,b G Z} is a ring, with the 
usual de nitio ns of addition and multiplication of complex numbers. 

5. The polynomial ring in one variable over a ring R is the ring R[x] = {a n x n + 
■ ■ ■ + a\x + a® | a« G R; i = 0, 1, . . . ,n; n € A/"}. (Elements of R[x] are 
added and multiplied using the usual rules for addition and multiplication of 
polynomials.) The degree of a polynomial a n x" + • • • + a\x + cio with a n ^ 
is n. A polynomial is monic if a n = 1. A polynomial f(x) is irreducible over 
R if f(x) cannot be factored as a product of polynomials in R[x] of degree 
less than the degree of f(x). A monic irreducible polynomial f(x) of degree 
k in Z p [x] (p prime) is primitive if the order of x in Z p [x]/(f(x)) is p k — 1, 
where (f(x)) = {f(x)g(x) \ g(x) € Z p [x]} (the ideal generated by f{x)). 

For example, the polynomial x 2 + 1 is 

(a) Irreducible in W[x] because x 2 + 1 has no real root 

(b) Reducible in C[x] because x 2 + 1 = (x - i)(x + i) 

(c) Reducible in Z 2 [x] because x 2 + 1 = (x + l) 2 

(d) Reducible in Z 5 [x] because x 2 + 1 = (x + 2)(x + 3) 

See the table on page 194. 

6. The division ring of quaternions is the ring ({a + bi + cj + dk \ a, b,c,d G 
K}, +, •), where operations are carried out using the rules for polynomial ad- 
dition and multiplication and the de ning relations for the quaternion group Q 
(see page 182). 

7 . Every octonion is a real linear combination of the unit octonions { 1, e i , e 2 , e% , 
e\, e$, eg, ey}. Their properties include: (a) e\ = —1; (b) e^ej = — e^e, when 
i ^ j; (c) the index doubling identity: e,ej = eu ==>■ e2,:e2j = 62k', and 
(d) the index cycling identity: e^ej = eu ==> ei+iej+i = eu+i where the 
indices are computed modulo 7. The full multiplication table is as follows: 





1 


ei 


e2 


e3 


e 4 


es 


ee 


e7 


1 


1 


ei 


e2 


e3 


e 4 


es 


ee 


e7 


ei 


ei 


-1 


e 4 


e7 


-e 2 


ee 


-es 


-e3 


e2 


e2 


-e 4 


-1 


es 


ei 


-e3 


e7 


-ee 


ez 


ez 


-e7 


-eh 


-1 


ee 


e2 


-e 4 


ei 


e 4 


e 4 


e2 


-ei 


-e 6 


-1 


e7 


e3 


-es 


es 


es 


-ee 


e3 


-e 2 


-e7 


-1 


ei 


e 4 


ee 


ee 


es 


-e7 


e 4 


-e3 


-ei 


-1 


e2 


e7 


e7 


e3 


ee 


-ei 


es 


-e 4 


-e 2 


-1 
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8. The following table gives examples of rings with additional properties: 



ring 


commuta- 


integral 


principal 


Euclidean 


division 


eld 




tive ring 


domain 


ideal 


domain 


ring 






with unity 




domain 








Q, ffi, C 


yes 


yes 


yes 


yes 


yes 


yes 


Z 


yes 


yes 


yes 


yes 


no 


no 


Z p (p prime) 


yes 


yes 


yes 


yes 


yes 


yes 


Z„ (n composite) 


yes 


no 


no 


no 


no 


no 


Z[x] 


yes 


yes 


no 


no 


no 


no 




no 


no 


no 


no 


no 


no 



2.7.4 FIELDS 

2.7.4.1 De nitions 

1. A eld (F, + , •) is a commutative ring with unity such that each non-zero ele- 
ment of F has a multiplicative inverse (equivalently, a eld is a commutative 
division ring). 

2. The characteristic of a eld (or a ring) is the smallest positive integer n such 
that 1 + 1 + • • • + 1 = (n summands). If no such n exists, the eld has 
characteristic (or characteristic oo). 

3. Field K is an extension eld of the eld F if F is a sub eld of K (i.e., F C K, 
and F is a eld using the same operations used in K). 

2.7.4.2 Examples of elds 

1. Q, M, and C with ordinary addition and multiplication are elds. 

2. Ij p (p a prime) is a eld under addition and multiplication modulo p. 

3. F[x]/(f(x)) is a eld, provided that F is a eld and f(x) is a non-constant 
polynomial irreducible in F[x]. 



2.7.5 QUADRATIC FIELDS 
2.7.5.1 De nitions 

1 . A complex number is an algebraic integer if it is a root of a polynomial with 
integer coef c ients that has a leading coef cient of 1 . 

2. If d is a square-free integer, then Q(Vd) = {a + bVd}, where a and b are 
rational numbers, is called a quadratic eld . If d > then Q( Vd) is a real 
quadratic eld ; if d < then Q(\/d) is an imaginary quadratic eld . 
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3. The integers of an algebraic number eld are the algebraic integers that belong 
to this number eld. 

4. If {a, P, 7} are integers in Q(Vd) such that cry = j3 then we say that a divides 
(3; written a\/3. 

5. An integer e in Q(Vd) is a unit if it divides 1. 

6. If a = a + bVd then 

(a) the conjugate of a is a = a — 

(b) the norm of a is iV(a) = aa = a 2 — db 2 . 

7. If a is an integer of Q( Vd) and if e is a unit of Q( Vd), then the number ea 
is an associate of a. A prime in Q(\/d) is an integer of Q>(Vd) that is only 
divisible by the units and its associates. 

8. A quadratic eld Q(Vd) is a Euclidean eld if, given integers a and j3 in 
Q(Vd) with P ^ 0, there are integers 7 and <5 in Q(\/d) such that a = 7/? + <5 
and |JV(tf)| < \N(P)\. 

9. A quadratic eld Q>(Vd) has the unique factorization property if, whenever a 
is a non-zero, non-unit, integer in Q( \fd) with a = eiti 7T2 • • • it r = e'^i ^2 ' ' ' f 
where e and e' are units, then r = s and the primes 7T, and 7rj can be paired off 
into pairs of associates. 



2.7.5.2 Facts about quadratic elds 

1. The integers of Q>(Vd) are of the form 

(a) a + bVd, with a and b integers, if d = 2 (mod 4) or d = 3 (mod 4). 

(b) a + b ( v ^~ 1 ) , with a and 6 integers, if d = 1 (mod 4). 

2. Norms are positive in imaginary quadratic elds, but not necessarily positive 
in real quadratic elds. It is always true that N(a(3) = N(a)N(fi). 

3. If a is an integer in Q(Vd) and N(a) is an integer that is prime, then a is 
prime. 

4. The number of units in Q(^/d) is as follows: 

(a) If d = -3, there are 6 units: ±1, ± , and ± ~ 1 ~/ = ^ . 

(b) If d = -1, there are 4 units: ±1 and ±i. 

(c) If d < and d ^ -1 and d ^ -3 there are 2 units: ±1. 

(d) If d > there are in nitely many units. There is a fundamental unit, eo, 
such that all other units have the form ±€q where n is an integer. 
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5. The quadratic eld Q(V^) is Euclidean if and only if d is one of the following: 
-11, -7, -3, -2, -1, 2, 3, 5, 6, 7, 11, 13, 17, 19, 21, 29, 33, 37, 41, 57, 73. 

6. If d < then the imaginary quadratic eld Q ( v ^) ^ as me umc l ue factoriza- 
tion property if and only if d is one of the following: —1, —2, —3, —7, —11, 
-19, -43, -163. 

7. Of the 60 real quadratic elds Q(Vd) with 2 < d < 100, exactly 38 of them 
have the unique factorization property: d = 2,3, 5, 6, 7, 11, 13, 14, 17, 19, 
21, 22, 23, 29, 31, 33, 37, 38, 41, 43, 46, 47, 53, 57, 59, 61, 62, 67, 69, 71, 73, 
77, 83, 86, 89, 93, 94, and 97. 

2.7.5.3 Examples of quadratic elds 

1. The algebraic integers of Q(\/— T) are of the form a + hi where a and b are 
integers; they are called the Gaussian integers. 

2. The number 1 + \/2 is a fundamental unit of Q(V2) . Hence, all units in Q( \/2) 
have the form ±(1 + V2) n for n = 0, ±1, ±2, . . . . 

3. The eld Q (>/— 5) is not a unique factorization domain. This is illustrated by 
6 = 2 • 3 = (1 + 7=5) • (1 - V=5), yet each of {2, 3, 1 + V=5, 1 - v^5} 
is prime in this eld. 

4. The eld Q (v'lO) is not a unique factorization domain. This is illustrated by 
6 = 2-3 = (4 + \/l0) • (4-i/l0), yet each of {2,3,4+ Vw, 4- v^O} is 
prime in this eld. 



2.7.6 FINITE FIELDS 

2.7.6.1 Facts about nite elds 

1 . If p is prime, then the ring Z p is a nite eld. 

2. If p is prime and n is a positive integer, then there is exactly one eld (up to 
isomorphism) withp™ elements. This eld is denoted GF(p n ) or F pn and is 
called a Galois eld . (See the table on page 190.) 

3. For Fa nite eld, there is a prime p and a positive integer n such that F has 
p n elements. The prime number p is the characteristic of F. The eld F is a 

nite extension of Z p , that is, F is a nite dimensional vector space over Z p . 

4. If F is a nite eld, then the set of non-zero elements of F under multiplication 
is a cyclic group. A generator of this group is a primitive element. 

5. There are <j>{p n — l)/n primitive polynomials of degree n (n > 1) over GF(p), 
where (/> is the Euler ^-function. (See table on page 128.) 
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6. There are — — — irreducible polynomials of degree k over GF(p n ), 

k 

where [i is the Mobius function. 

7. If F is a nite eld where \F\ = k and p(x) is a polynomial of degree n 
irreducible over F, then the eld F[x]/(p(x)) has order k n . If a is a root of 
p(x) £ F[x] of degree n > 1, then F[a;]/(p(a;)) = {c„_iq;™ _1 + • • • + c\a + 
c | Ci € F for all i}. 

8. When p is a prime, GF(p n ) can be viewed as a vector space of dimension 
n over F p . A basis of F p ™ of the form {a, a p , aP , . .., a p " } is called a 
normal basis. If a is a primitive element of F pn , then the basis is said to be a 
primitive normal basis. Such an a satis es a primitive normal polynomial of 
degree n over F p . 



Degree 

n 


Primitive normal polynomials 




p=2 p=3 






p = 5 


2 




+ x + l x 2 +x + 2 




a; 2 


+ a; + 2 


3 


x 3 


+ x 2 + 1 x 3 + 2x 2 + 1 




X 3 


+ a; 2 +2 


4 


x 4 


+ x 3 + 1 a; 4 + a; 3 + 2 




x 4 


+ x 3 + Ax + 2 


5 


X 5 


+ x 4 + x 2 + x + 1 x 5 + 2x 4 + 1 




X 5 


+ 2a; 4 + 3 


6 


X 6 


+ a; 5 + 1 a; 6 + a; 5 + x 3 


+ 2 


X 6 


+ a; 5 +2 


7 


X 7 


+ x 6 + 1 a; 7 + a; 6 + a; 2 


+ 1 


X 7 


+ a; 6 +2 



2.7.7 HOMOMORPHISMS AND ISOMORPHISMS 
2.7.7.1 De nitions 

1. A group homomorphism from group G\ to group G2 is a function <^ : G\ — > 
G2 such that i/j(afo) = ip(a)ip(b) for all a, 6 € Gi. Nofe: a<p is often written 
instead of <p(a). 

2. A character of a group G is a group homomorphism x ■ G — > C * (non-zero 
complex numbers under multiplication). (See table on page 191.) 

3. A ring homomorphism from ring i?i to ring i? 2 is a function tp : i?i — > i? 2 
such that <^(a + 6) = <^(a) + <£>(6) and i^(afo) = ip(a)ip(b) for all a,b £ R\. 

4. An isomorphism from group (ring) Si to group (ring) £2 is a group (ring) 
homomorphism tp : Si — > 52 that is 1-1 and onto S'2. If an isomorphism 
exists, then Si is said to be isomorphic to S2 . Write Si = S2 . (See the table 
on page 176 for numbers of non-isomorphic groups and the table on page 178 
for examples of groups of orders less than 16.) 

5. An automorphism of S is an isomorphism ip : S — > S. 

6. The kernel of a group homomorphism <p : G\ — > G2 is l p~ 1 (e) = {g £ 
Gi I (p(g) = e}. The kernel of a ring homomorphism <p : R\ — > J? 2 is 
^-i(0)={rG J Ri |^(r)=0}. 
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2.7.7.2 Facts about homomorphisms and isomorphisms 

1. If tp : G\ — > G2 is a group homomorphism, then tp{G\) is a subgroup of G2. 

2. Fundamental homomorphism theorem for groups: If tp : G\ — > G2 is a 
group homomorphism with kernel K, then 7f is a normal subgroup of G 1 and 

Gi/tf = tp{G,). 

3. If G is a cyclic group of in nite order, then G = (Z, +). 

4. If G is a cyclic group of order n, then G = (Z„, +). 

5. If p is prime, then there is only one group (up to isomorphism) of order p, the 
group (Z p ,+). 

6. Cayley's theorem: If G is a nite group of order n, then G is isomorphic to 
some subgroup of the group of permutations on n objects. 

7. Z m x Z„ = Z mn if and only if m and n are relatively prime. 

8. If n = n\ ■ 712 • . . . • rik where each n, is a power of a different prime, then 

Z n = Z ni x Z n2 x • • • x Z nfc . 

9. Fundamental theorem of nite abelian groups: Every nite abelian group G 
(order > 2) is isomorphic to a product of cyclic groups where each cyclic 
group has order a power of a prime. That is, there is a unique set {n 1 , . . . , n& } 
where each n, is a power of some prime such that G = Z m x Z„ 2 x • • • x Z nh . 

10. Fundamental theorem of nitely generated abelian groups: If G is a nitely 
generated abelian group, then there is a unique integer n > and a unique set 
{rii, . . . , rik} where each n, is a power of some prime such that G = Z ni x 
Z n2 x • • • x Z nj! x Z™ (G is w'/efy generated if there are ai , 02 , . . . , a n £ G 
such that every element of G can be written as aj^aj^ • • • where A;, € 
{1, . . . , n} (the ki are not necessarily distinct) and e, € {1,-1}). 

1 1 . Fundamental homomorphism theorem for rings: If tp : R 1 — > i?2 is a ring 
homomorphism with kernel then K is an ideal in R\ and R\/K = ip(Ri). 



2.7.8 MATRIX CLASSES THAT ARE GROUPS 

In the following examples, the group operation is ordinary matrix multiplication: 

1. GL(n, C) all complex non-singular n x n matrices 

2. GL(n, K) all real non-singular n x n matrices 

3. 0(n) all n x n matrices A with AA T = I, also called the 

orthogonal group 

4. SL(n,C) all complex n x n matrices of determinant 1, also called 

the unimodular group or the special linear group 

5. SL(n, R) all real n x n matrices of determinant 1 
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6. 50(2) 



7. SO (a) 

8. SU(n) 

9. U{n) 



rotations of the plane: matrices of the form 

4 fa\ _ cos ^ — sin ^ 
sin# cos# 
rotations of n-dimensional space 
all n x n unitary matrices of determinant 1 
all n x n unitary matrices with UU H = I 



2.7.9 PERMUTATION GROUPS 



Name 


Symbol 


Order 


De nition 


Symmetric group 




n\ 


All permutations on {1,2,..., n} 


Alternating group 


A n 


n!/2 


All even permutations on {1, 2, . . . , n} 


Cyclic group 


C n 


n 


Generated by (12 ■ ■ ■ n) 


Dihedral group 


D„ 


2n 


Generated by (12 ■ ■ ■ n) and 








(ln)(2n-l)(3n-2)--- 


Identity group 




1 


(1)(2) ■ ■ ■ (n) is the only permutation 



EXAMPLE With p = 3 elements, the identity permutation is (123), and: 
A 3 = {(123), (231), (312)}, 
C 3 = {(123), (231), (312)}, 
D 3 = {(231), (213), (132), (321), (312), (123)}, 
E 3 = {(123)} and 

S 3 = {(231), (213), (132), (321), (312), (123)}. 

2.7.9.1 Creating new permutation groups 

Let A have permutations {X{\, order n, degree d, let B have permutations {Yj}, 
order m, degree e, and let C (a function of A and B) have permutations { Wu }, order 
p, degree /. 



Name 


De nition 


Permutation 


Order 


Degree 


Sum 
Product 
Composition 
Power 


C = A + B 
C = A x B 
C = A[B] 
C = B A 


W = XUY 
W = X xY 
W = X xY 
W = Y X 


p = ran 
p = ran 
p = mn d 
p = ran 


f = d+e 
f = de 
f = de 
f = e d 



2.7.9.2 Polya theory 

Let 7T be a permutation. De ne Inv (tt) to be the number of invariant elements (i.e., 
mapped to themselves) in tt. De ne eye (tt) as the number of cycles in tt. Suppose tt 
has bi cycles of length 1, hi cycles of length 2, . . . , bu cycles of length k in its unique 
cycle decomposition. Then tt can be encoded as the expression x J 1 x^ 2 ■ ■ ■ x b k k . Sum- 
ming these expressions for all permutations in the group G, and normalizing by the 
number of elements in G results in the cycle index of the group G: 

P G (x 1 ,x 2 ,...,x l ) = -±-J2 ( x i lx 2 ■■■4")- (2- 7 -D 
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1. Burnside's Lemma: Let G be a group of permutations of a set A, and let S be 
the equivalence relation on A induced by G. Then the number of equivalence 

classes in A is given by — — > Inv (tt) . 

|G| 

2. Special case of Poly a' s theorem: Let i? be an to element set of colors. Let 
G be a group of permutations {7Ti , 7T2 , . . . } of the set A. Let C(A, R) be the 
set of colorings of the elements of A using colors in R. Then the number of 
distinct colorings in C(A, R) is given by 



J-r 

\G\ I 



3. Poly a 's theorem: Let G be a group of permutations on a set A with cycle index 
Pq (xi , xi , . . . , Xk) ■ Let C(A, R) be the collection of all colorings of A using 
colors in R. If w is a weight assignment on R, then the pattern inventory of 
colorings in C(A, R) is given by 

P G (^ W (r),^ W 2 (r),---^^(r)j. 

\reR reR reR J 



EXAMPLES 

1. Consider necklaces constructed of 2k beads. Since a necklace can be ipped over, 
the appropriate permutation group is G = {771,772} with wi = (1)(2) . . . (2k) and 
7T 2 = (1 2k) (2 2Jfc-l)(3 2k-2)...(k k + l). Hence, cyc(Tn) = 2k, 
eye (772) = k, and the cycle index is Pq(xi, X2) = (x\ k + x\) J2. Using r colors, 
the number of distinct necklaces is (r 2k + r k )/2. 

For a 4 bead necklace (k = 2) using r = 2 colors (say w\ = b for "black" and wi= w 
for "white"), the (2 4 + 2 2 )/2 = 10 different necklaces are {bbbb}, {bbbw}, {bbwb}, 
{bbww}, {bwbw}, {bwwb}, {wbbw}, {bwww}, {wbww}, and {nnmiiai). The pat- 
tern inventory of colorings, Pg(53« w «> Si w 1) = ((b + w) 4 + (b 2 + w 2 ) 2 ) J2 = 
b* + 2b 3 w + 4b 2 w 2 + 2bw 3 + w 4 , tells how many colorings of each type there are. 

2. Consider coloring the corners of a square. If the squares can be rotated, but not re- 
ected, then the number of distinct colorings, using k colors, is i (k 4 + k 2 +2k). If 
the squares can be rotated and re ected, then the number of distinct colorings, using k 
colors, is i (k* + 2k 3 + 3k 2 + 2k) . 

(a) If k = 2 colors are used, then there are 6 distinct classes of colorings whether 
re ections are allowed, or not. These classes are the same in both cases. The 16 
colorings of a square with 2 colors form 6 distinct classes as shown: 





h c 




1 • 




ft r 




• c 

1 c 






J O 

c 
















• L 

• C 




• • 

D C 




j • 
i • 




J L, 
• • 




• c 


J • 
• c 


















J • 




• L 




• • 




• • 






• • 

• • 
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(b) If ft = 3 colors are used, then there are 21 distinct classes of colorings if re ections 
are allowed, and 24 distinct classes of colorings if re ections are not allowed. 
Shown below are representative elements of each of these classes: 



• 









include these 3 for no re ections case 



2.7.9.3 Polya theory tables 

1 . Number of distinct corner colorings of regular polygons using rotations and 
re ection s, or rotations only, with no more than k colors: 



object 


rotations & re ections 
k = 2 k = 3 k=A 


rotations only 
k — 2 k — 3 k 


= 4 


triangle 


4 


10 


20 


4 


11 


24 


square 


6 


21 


55 


6 


24 


70 


pentagon 


8 


39 


136 


8 


51 


208 


hexagon 


13 


92 


430 


14 


130 


700 



2. Coloring regular 2- and 3- dimensional objects with no more than k colors: 



tetrahedron 




corners of a tetrahedron 


± (k 6 + Zk A + 8k 2 ) 


edges of a tetrahedron 


± (k 6 + 2>k A + 8k 2 ) 


faces of a tetrahedron 


±(k* + llk 2 ) 


cube 




corners of a cube 


± (k s + 17k 4 + 6k 2 ) 


edges of a cube 


± (k 12 + 6k 7 + 3fc 6 + 8k A + 6k 3 ) 


faces of a cube 


± (k 6 + 3k 4 + 12k 3 + 8k 2 ) 
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corners of a triangle 




with rotations 


H (* 3 + 2k) 


with rotations and re ections 


\ (k 3 + 3k 2 + 2k) 


corners of a square 




with rotations 


\ (k 4 + k 2 + 2k) 


with rotations and re ections 


\ (k 4 + 2k 3 + 3k 2 + 2k) 


corners of a pentagon 




with rotations 


\ (k 5 + 4k) 


with rotations and re ections 


± (k° + 5fc 3 + 4k) 


corners of a hexagon 




with rotations 

VV ± LAX I V ' L 11 LlVyllO 


- (k 6 + k 3 + 2k' 2 + 2k) 

^ y Iv I Iv I £J iv I £J iv J 


with rotations and re ections 


± (k 6 + 3k 4 + 4k 3 + 2k 2 + 2k) 


corners of a regular polygon 


-J2<f>(d)k^ 

d\n 


with rotations 


with rotations and re ections (n even) 




with rotations and re ections (n odd) 


d\n 
d\n 



3. The cycle index P{x\ , x<i , . . . ) and number of black- white colorings 
of regular objects under all permutations 



corners of a triangle 

cycle index | (x 3 + 3x\x^ + 2x3) 

pattern inventory 16 3 + lb 2 w + Ibw 2 + lw 3 
corners of a square 

cycle index | (x\ + 2x\xi + 3x\ + 2x4) 

pattern inventory lb 4 + lb 3 iv + 2b 2 iv 2 + Ibw 3 + lw 4 
corners of a pentagon 

cycle index iyx\ + 4x$ + 5xix%) 

pattern inventory lb 5 + lb 4 iv + 2b 3 iv 2 + 2b 2 iv 3 + lbiv 4 + liv 5 
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corners of a cube 

cycle index ^ (xf + Qx\ + %x\ + &x\x\) 

pattern inventory b 8 + bhv + 3b 6 iv 2 + 3b 5 w 3 + 7b 4 w 4 

+3b 3 w 5 + 3b 2 w 6 + bw 7 + iv 8 



Note that the pattern inventory for the black-white colorings is given by 
P((b + w),(b 2 +w 2 )Ab 3 +w 3 ),...). 



2.7.10 TABLES 

2.7.10.1 Number of non-isomorphic groups of different orders 

The lOn + k entry is found by looking at row n_ and the column Jt. There are 
10,494,213 non-isomorphic groups with 512 elements. 





_0 .1 


_2 _3 


_4 


_5 


_6 .7 


_8 


.9 


0_ 


1 


1 1 


2 


1 


2 1 


5 


2 


1_ 


2 1 


5 1 


2 


1 


14 1 


5 




2_ 


5 2 


2 1 


15 


2 


2 5 


4 




3_ 


4 1 


51 1 


2 


1 


14 1 


2 




4_ 


14 1 


6 1 


4 


2 


2 1 


52 




5_ 


5 1 


5 1 


15 


2 


13 2 


2 




6_ 


13 1 


2 4 


267 


1 


4 1 


5 




7_ 


4 1 


50 1 


2 


3 


4 1 


6 




8_ 


52 15 


2 1 


15 


1 


2 1 


12 




9_ 


10 1 


4 2 


2 


1 


231 1 


5 




10_ 


16 1 


4 1 


14 


2 


2 1 


45 




11_ 


6 2 


43 1 


6 


1 


5 4 


2 




12. 


47 2 


2 1 


4 


5 


16 1 


2328 




13_ 


4 1 


10 1 


2 


5 


15 1 


4 




14_ 


11 1 


2 1 


197 


1 


2 6 


5 




15_ 


13 1 


12 2 


4 


2 


18 1 


2 




16_ 


238 1 


55 1 


5 


2 


2 1 


57 




17. 


4 5 


4 1 


4 


2 


42 1 


2 




18_ 


37 1 


4 2 


12 


1 


6 1 


4 


13 


29_ 


4 1 


1543 1 


2 


2 


12 1 


10 




20_ 


52 2 


2 2 


12 


2 


2 2 


51 




21. 


12 1 


5 1 


2 


1 


177 1 


2 


2 


22_ 


15 1 


6 1 


197 


6 


2 1 


15 


1 
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_o 


_\ 


J2 


_3 


_4 


_5 


_6 _7 


_8 3 


23_ 


4 


2 


14 


1 


16 


1 


4 2 


4 1 


24_ 


208 


1 


5 


67 


5 


2 


4 1 


12 1 


25_ 


15 


1 


46 


2 


2 


1 


56092 1 


6 1 


26_ 


15 


2 


2 


1 


39 


1 


4 1 


4 1 


27_ 


30 


1 


54 


5 


2 


4 


10 1 


2 4 


28_ 


40 


1 


4 


1 


4 


2 


4 1 


1045 2 


29_ 


4 


2 


5 


1 


23 


1 


14 5 


2 1 


30_ 


49 


2 


2 


1 


42 


2 


10 1 


9 2 


31_ 


6 


1 


61 


1 


2 


4 


4 1 


4 1 


32_ 


1640 


1 


4 


1 


176 


2 


2 2 


15 1 


33_ 


12 


1 


4 


5 


2 


1 


228 1 


5 1 


34_ 


15 


1 


18 


5 


12 


1 


2 1 


12 1 


35_ 


10 


14 


195 


1 


4 


2 


5 2 


2 1 


36_ 


162 


2 


2 


3 


11 


1 


6 1 


42 2 


37_ 


4 


1 


15 


1 


4 


7 


12 1 


60 1 


38_ 


11 


2 


2 


1 


20169 2 


2 4 


5 1 


39_ 


12 


1 


44 


1 


2 


1 


30 1 


2 5 


40_ 


221 


1 


6 


1 


5 


16 


6 1 


46 1 


41_ 


6 


1 


4 


1 


10 


1 


235 2 


4 1 


42_ 


41 


1 


2 


2 


14 


2 


4 1 


4 2 


43_ 


4 


1 


775 


1 


4 


1 


5 1 


6 1 


44_ 


51 


13 


4 


1 


18 


1 


2 1 


1396 1 


45_ 


34 


1 


5 


2 


2 


1 


54 1 


2 5 


46_ 


11 


1 


12 


1 


51 


4 


2 1 


55 1 


47_ 


4 


2 


12 


1 


6 


2 


11 2 


2 1 


48_ 


1213 


1 


2 


2 


12 


1 


261 1 


14 2 


49_ 


10 


1 


12 


1 


4 


4 


42 2 


4 1 


50_ 


56 


1 


2 


1 


202 


2 


6 6 


4 1 


51_ 


8 


1 


* 


15 


2 


1 


15 1 


4 1 



2.7.10.2 Number of non-isomorphic Abelian groups of different 
orders 

The lOn + k entry is in row n_ and column _fc. 





.0 


_1 


.2 


.3 


_4 


_5 


_6 


.7 


_8 


3 


0. 






1 




2 


1 


1 


1 


3 


2 


1. 


1 




2 




1 


1 


5 


1 


2 


1 


2. 


2 




1 




3 


2 


1 


3 


2 


1 


3. 


1 




7 




1 


1 


4 


1 


1 


1 


4. 


3 




1 




2 


2 


1 


1 


5 


2 


5. 


2 




2 




3 


1 


3 


1 


1 


1 
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2.7.10.3 Names of groups of small order 



Order n 


Distinct groups of order n 


1 


{e} 










2 


C 2 










3 


c 3 










4 


c 4 , 


V = c 2 


x C 2 






5 


c 5 










6 


C 8 , 










7 


C 7 










8 


c 8 , 


C 2 x C 4 


C 2 x C 2 x C 2 , 




Q 


9 


c 9 , 


C 3 x C 3 








10 


C±0> 


D 5 








11 


Cn 










12 


Cl2, 


C 2 xC 


3 , T = C 3 xC 4; 






13 


Cl3 










14 


Ci4, 


D 7 








15 


Ci B 











2.7.10.4 Representations of groups of small order 

In all cases the identity element, {1}, forms a group of order 1. 

1 . C2 , the cyclic group of order 2 

Generator: a with relation a 2 = 1 





1 


a 


1 


1 


a 


a 


a 


1 



Elements Subgroups 
(a) order 2: a (a) order 2: {l,a} 

2. C3, the cyclic group of order 3 

Generator: a with relation a 3 = 1 





1 


a 


a 2 


1 


1 


a 


a 2 ^ 


a 


a 


a 2 


1 


a 2 


a 2 


1 


a 



Elements Subgroups 
(a) order 3: a, a 2 (a) order 3: {l,a, a 2 } 

3. C4, the cyclic group of order 4 

Generator: a with relation a 4 = 1 





1 


a 


a 2 


a 3 


1 


1 


a 


a 2 


a 3 


a 


a 


a 2 


a 3 


1 


a 2 


a 2 


a 3 


1 


a 


a 3 


a 3 


1 


a 


a 2 
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Elements 

(a) order 4: a, a 3 

(b) order 2: a 2 



Subgroups 

(a) order 4: {l,a,a 2 ,a 3 } 

(b) order 2: {l,a 2 } 



4. V, the Klein four group 

Generators: a, b with relations a 2 = l,b 2 = 1, 6a 





1 


a 


b 


a& 


1 


1 


a 


b 


afo 


a 


a 


1 


ab 


6 


6 


6 


afo 


1 


a 


afe 


ab 


b 


a 


1 



Elements 
(a) order 2: a, b, ab 

5. C5, the cyclic group of order 5 

Generator: a with relation a 5 = 1 



Subgroups 

(a) order 4: {l,a, 6,a6} 

(b) order 2: {l,a}, {1,6}, {l,a&} 





1 


a 


a 2 


a 3 


a 4 


1 


1 


a 


a y 


a 3 


a 4 


a 


a 


a 2 


a 3 


a 4 


1 


a 2 


a 2 


a 3 


a 4 


1 


a 


a 3 


a 3 


a 4 


1 


a 


a 2 


a 4 


a 4 


1 


a 


a 2 


a 3 



Elements 
(a) order 5: a, a 2 , a 3 , a 4 

6. Cg, the cyclic group of order 6 

Generator: a with relation a 6 = 



Subgroups 
(a) order 5: {l, a, a 2 , a 3 , a 4 } 



1 





1 


a 


a 2 


a 3 


a 4 


a 5 


1 


1 


a 


a 1 


a 3 


a 4 


a 5 


a 


a 


a 2 


a 3 


a 4 


a 5 


1 


a 2 


a 2 


a 3 


a 4 


a 5 


1 


a 


a 3 


a 3 


a 4 


a 5 


1 


a 


a 2 


a 4 


a 4 


a 5 


1 


a 


a 2 


a 3 


a 5 


a 5 


1 


a 


a 2 


a 3 


a 4 



EJeiiients 

(a) order 6: a, a 5 

(b) order 3: a 2 , a 4 

(c) order 2: a 3 



Subgroups 

(a) order 6: {l, a, a 2 , a 3 , a 4 , a 5 } 

(b) order 3: {l,a 2 ,a 4 } 

(c) order 2: {l,a 3 } 
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7. 53, the symmetric group on three elements 

Generators: a, b with relations a 3 = 1, b 2 = 1, 6a 





1 


a 


a 2 


b 


ab 


a 2 b 


1 


1 


a 


a 2 


b 


ab 


a 2 b 


a 


a 


a 2 


1 


ab 


a 2 b 


b 


a 2 


a 2 


1 


a 


a 2 b 


b 


ab 


6 


b 


a 2 b 


ab 


1 


a 2 


a 


ab 


ab 


b 


a 2 b 


a 


1 


a 2 


a 2 b 


a 2 b 


ab 


b 


a 2 


a 


1 



Elements 

(a) order 3: a, a 2 

(b) order 2: b, ab, a 2 b 

Subgroups 

(a) order 6: {l, a, a 2 , b, ab, a 2 b] 

(b) order 3: {l, a, a 2 } 

(c) order 2: {1, b}, {1, ab}, {l,a 2 b} 

8. Cy, the cyclic group of order 7 

Generator: a with relation a 7 = 1 



(is a normal subgroup) 
(is a normal subgroup) 





1 


a 


a 2 


a 3 


a 4 


a 5 


a 6 


1 


1 


a 


a y 


a 3 


a 4 


a b 


a* 


a 


a 


a 2 


a 3 


a 4 


a 5 


a 6 


1 


a 2 


a 2 


a 3 


a 4 


a 5 


a 6 


1 


a 


a 3 


a 3 


a 4 


a 5 


a 6 


1 


a 


a 2 


a 4 


a 4 


a 5 


a 6 


1 


a 


a 2 


a 3 


a 5 


a 5 


a 6 


1 


a 


a 2 


a 3 


a 4 


a 6 


a 6 


1 


a 


a 2 


a 3 


a 4 


a 5 



Elements 
(a) order 7: a, a 2 , a 3 

9. Cg, the cyclic group of order 8 

Generator: a with relation a 8 = 1 



Subgroups 
(a) order 7: {l, a, a 2 , c 





1 


a 


a 2 


a 3 


a 4 


a 5 


a 6 


a 7 


1 


1 


a 


a 2 


a 3 


a 4 


a & 


a« 


a' 


a 


a 


a 2 


a 3 


a 4 


a 5 


a 6 


a 7 


1 


a 2 


a 2 


a 3 


a 4 


a 5 


a 6 


a 7 


1 


a 


a 3 


a 3 


a 4 


a 5 


a 6 


a 7 


1 


a 


a 2 


a 4 


a 4 


a 5 


a 6 


a 7 


1 


a 


a 2 


a 3 


a 5 


a 5 


a 6 


a 7 


1 


a 


a 2 


a 3 


a 4 


a 6 


a 6 


a 7 


1 


a 


a 2 


a 3 


a 4 


a 5 


a 7 


a 7 


1 


a 


a 2 


a 3 


a 4 


a 5 


a 6 
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Elements 

(a) order 8: a, a 3 , a 5 , a 7 

(b) order 4: a 2 , a 6 

(c) order 2: a 4 



Subgroups 

(a) order 8: 

{1, a, a 2 , a 3 , a 4 , a 5 , a 6 , a 7 } 

(b) order4: {l,a 2 ,a 4 ,a 6 } 

(c) order 2: {l,a 4 } 



10. C4 x C%, the direct product of a cyclic group of order 4 and a cyclic group 
of order 2 

Generators: a, 6 with relations a 4 = 1, b 2 = 1, and 6a = a6 





1 


a 


a 2 


a 3 


b 


ab 


a 2 b 


a 3 b 


1 


1 


a 


a 2 


a 3 


b 


ab 


a 2 b 


a 3 b 


a 


a 


a 2 


a 3 


1 


ab 


a 2 b 


a 3 b 


b 


a 2 


a 2 


a 3 


1 


a 


a 2 b 


a 3 b 


b 


ab 


a 3 


a 3 


1 


a 


a 2 


a 3 b 


b 


ab 


a 2 b 


b 


b 


ab 


a 2 b 


a 3 b 


1 


a 


a 2 


a 3 


ab 


ab 


a 2 b 


a 3 b 


b 


a 


a 2 


a 3 


1 


a 2 b 


a 2 b 


a 3 b 


b 


ab 


a 2 


a 3 


1 


a 


a 3 b 


a 3 b 


b 


ab 


a 2 b 


a 3 


1 


a 


a 2 



Elements 
(a) order 4: a, a 3 



ab, 



(b) order 2: a 2 , b, a 2 b 
Subgroups 

(a) order 8: {l, a, a 2 , a 3 , b, ab, a 2 b, a 3 b} 

(b) order4: {l,a,a 2 ,a 3 } { 1, ab, a 2 , a 3 b} {l,a 2 ,6,a 2 6} 

(c) order2: {l, a 2 }, {1, &}, {l,a 2 b} 

11. C-2 x C-2 x C-2, the direct product of 3 cyclic groups of order 2 



Generators: a, 6, c with relations a 

cb = be 



1, 6 = 1, c 2 = 1, 6a = a6, ca 



ac, 





1 


a 


b 


ab 


c 


ac 


be 


abc 


1 


1 


a 


b 


ab 


c 


ac 


be 


abc 


a 


a 


1 


ab 


b 


ac 


c 


abc 


be 


6 


6 


ab 


1 


a 


be 


abc 


c 


ac 


ab 


ab 


6 


a 


1 


abc 


be 


ac 


c 


c 


c 


ac 


6c 


abc 


1 


a 


b 


ab 


ac 


ac 


c 


abc 


be 


a 


1 


ab 


b 


be 


be 


abc 


c 


ac 


6 


ab 


1 


a 


abc 


abc 


be 


ac 


c 


ab 


b 


a 


1 



Elements 
(a) order 2: a, 6, a6, c, ac, 6c, a6c 
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Subgroups 

(a) order 8: {1, a, b, ab, c, ac, be, abc} 

(b) order 4: {1, a, b, ab}, {1, a, c, ac}, {l,a, be, abc}, {1,6, 
{1, b, ac, abc}, {1, ab, c, abc}, {1, ab, ac, be} 

(c) order 2: {1, a}, {1, b}, {1, ab}, {1, c}, {1, ac}, {1, be}, 



c, be}, 
{1, abc} 



12. Di, the dihedral group of order 8 

Generators: a, b with relations a 4 ~ 



1, b 2 = 1, ba 





1 


a 


a 2 


a 3 


b 


ab 


a 2 b 


a 3 b 


1 


1 


a 


a 2 


a 3 


b 


ab 


a 2 b 


a 3 b 


a 


a 


a 2 


a 3 


1 


ab 


a 2 b 


a 3 b 


b 


a 2 


a 2 


a 3 


1 


a 


a 2 b 


a 3 b 


b 


ab 


a 3 


a 3 


1 


a 


a 2 


a 3 b 


b 


ab 


a 2 b 


6 


b 


a 3 b 


a 2 b 


ab 


1 


a 3 


a 2 


a 


ab 


ab 


b 


a 3 b 


a 2 b 


a 


1 


a 3 


a 2 


a 2 b 


a 2 b 


ab 


b 


a 3 b 


a 2 


a 


1 


a 3 


a 3 b 


a 3 b 


a 2 b 


ab 


b 


a 3 


a 2 


a 


1 



Elements 

(a) order 4: a, a 3 

(b) order 2: a 2 , b, ab, a 2 b, a 3 b 

Subgroups 

(a) order 8: {l, a, a 2 , a 3 , b, ab, a 2 b, a 3 b} 

(b) order4: {l, a 2 , b, a 2 b}, {l, a, a 2 , a 3 }, {l, a 2 , ab, a 3 b} 

(c) order 2: {1,6}, {l,a 2 6}, {l, a 2 }, {1, a6}, {l,a 3 6} 

Normal subgroups 

(a) order 8: {l, a, a 2 , a 3 , 6, a6, a 2 6, a 3 6} 

(b) order4: {l, a 2 , 6, a 2 6}, {l, a, a 2 , a 3 }, {l, a 2 , a6, a 3 6} 

(c) order 2: jl,a 2 } 

13. Q, the quaternion group (of order 8) 



: a, 6 with relations 


a 4 = 


1,6 2 


= a 2 


, ba = 


arH 






1 


a 


a 2 


a 3 


b 


ab 


a 2 b 


a 3 b 


1 


1 


a 


a 1 


a 3 


b 


ab 


d 2 b 


a 3 b 


a 


a 


a 2 


a 3 


1 


ab 


a 2 b 


a 3 b 


b 


a 2 


a 2 


a 3 


1 


a 


a 2 b 


a 3 b 


b 


ab 


a 3 


a 3 


1 


a 


a 2 


a 3 b 


b 


ab 


a 2 b 


b 


b 


a 3 6 


a 2 6 


ab 


a 2 


a 


1 


a 3 


ab 


ab 


6 


a 3 6 


a 2 b 


a 3 


a 2 


a 


1 


a 2 b 


a 2 b 


ab 


6 


a 3 b 


1 


a 3 


a 2 


a 


a 3 b 


a 3 b 


a 2 b 


ab 


b 


a 


1 


a 3 


a 2 



Elements 

(a) order 4: a, a 3 , b, ab, a 2 b, a 3 b 

(b) order 2: a 2 
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Subgroups 

(a) order 8: {l, a, a 2 , a 3 , b, ab, a 2 b, a 3 } 

(b) order4: {l, a, a 2 , a 3 }, { 1, b, a 2 , a 2 b}, {l, ab, a 2 , a 3 b} 

(c) order 2: {l,a 2 } 

Normal subgroups 

(a) order 8: {l, a, a 2 , a 3 , b, ab, a 2 b, a 3 } 

(b) order4: {l, a, a 2 , a 3 }, { 1, b, a 2 , a 2 b], {l, ab, a 2 , a 3 b) 

(c) order 2: {l,a 2 } 



Notes 



Q can be de ned as the set {1, —i, j, —j, k, —k} where multiplica- 
tion is de ned by: 



-ik = j 
(2.7.2) 



= k 2 




1, ij 


= ~ji 


= k, jk = 


-kj 


= i, 


ki = 


X 


+1 


-1 


+i 


—i 


+3 


~3 


+k 


-k 


+1 


+1 


-1 


+i 


—i 


+3 


~3 


+k 


-k 


-1 


-1 


+ 1 


—i 


+i 


~3 


+3 


-k 


+k 


+i 


+i 


—i 


-1 


+ 1 


+k 


-k 


-3 


+3 


—i 


—i 


+i 


+ 1 


-1 


-k 


+k 


+3 


~3 


+3 


+3 


~3 


-k 


+k 


-1 


+1 


+i 


—i 


-j 


~3 


+3 


+k 


-k 


+1 


-1 


—i 


+i 


+k 


+k 


-k 


+3 


-3 


—i 


+i 


-1 


+1 


-k 


-k 


+k 


~3 


+3 


+i 


—i 


+1 


-1 



Elements 

(a) order 4: i, -i, j, - j, k, —k 

(b) order 2: -1 

Subgroups (all of them are normal subgroups) 

(a) order 8: {1, —1, i, —j, k, —k} 

(b) order 4: {1, i, -1, -i}, {l,j, -1, -j}, {1, k, -1, -k} 

(c) order 2: {1,-1} 

• Q can be de ned as the group composed of the 8 matrices: 

_ ri o] _ _ r-i oi 

q ~ 1 ' q ~ —1 ' 1 
_ [o i] ■ _ [0 -i] 

^ 3q — ■ r, j 3q — ■ n ' ^ 9 



-i 
i 



1 

-1 



kn 



where a subscript of q indicates a quaternion element, i 2 
matrix multiplication is the group operation. 



-1 


1, and 
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14. Cg, the cyclic group of order 9 

Generator: a with relation a 9 = 1 





1 


a 


a 2 


a 3 


a 4 


a 5 


a 6 


a 7 


a 8 


1 


1 


a 


a y 


a 3 


a 4 


a b 


a d 


a v 


a H 


a 


a 


a 2 


a 3 


a 4 


a 5 


a 6 


a 7 


a 8 


1 


a 2 


a 2 


a 3 


a 4 


a 5 


a 6 


a 7 


a 8 


1 


a 


a 3 


a 3 


a 4 


a 5 


a 6 


a 7 


a 8 


1 


a 


a 2 


a 4 


a 4 


a 5 


a 6 


a 7 


a 8 


1 


a 


a 2 


a 3 


a 5 


a 5 


a 6 


a 7 


a 8 


1 


a 


a 2 


a 3 


a 4 


a 6 


a 6 


a 7 


a 8 


1 


a 


a 2 


a 3 


a 4 


a 5 


a 7 


a 7 


a 8 


1 


a 


a 2 


a 3 


a 4 


a 5 


a 6 


a 8 


a 8 


1 


a 


a 2 


a 3 


a 4 


a 5 


a 6 


a 7 



Elements 

(a) order 9: a, a 2 , a 4 , a 5 , a 6 , a 7 

(b) order 3: a 3 , a 6 

Subgroups 

(a) order 9: {l, a, a 2 , a 3 , a 4 , a 5 , a 6 , a 7 , a 8 } 

(b) order3: {l,a 3 ,a 6 } 

15. C3 x C3, the direct product of two cyclic groups of order 3 

Generators: a, b with relations a 3 = 1, b 3 = 1, 6a = afo 





1 


a 


a 2 


b 


ab 


a 2 b 


b 2 


ab 2 


a 2 b 2 


1 


1 


a 


a 2 


b 


ab 


a 2 b 


b 2 


ab' 2 


a 2 V 2 


a 


a 


a 2 


1 


ab 


a 2 b 


b 


ab 2 


a 2 b 2 


b 2 


a 2 


a 2 


1 


a 


a 2 b 


b 


ab 


a 2 b 2 


b 2 


ab 2 


6 


b 


ab 


a 2 b 


b 2 


ab 2 


a 2 b 2 


1 


a 


a 2 


ab 


ab 


a 2 b 


b 


ab 2 


a 2 b 2 


b 2 


a 


a 2 


1 


a 2 b 


a 2 b 


b 


ab 


a 2 b 2 


b 2 


ab 2 


a 2 


1 


a 


b 2 


b 2 


ab 2 


a 2 b 2 


1 


a 


a 2 


b 


ab 


a 2 b 


ab 2 


ab 2 


a 2 b 2 


b 2 


a 


a 2 


1 


ab 


a 2 b 


b 


a 2 b 2 


a 2 b 2 


b 2 


ab 2 


a 2 


1 


a 


a 2 b 


b 


ab 



Elements 

(a) order 3: a,a 2 ,b, ab, a 2 b, b 2 , ab 2 , a 2 b 2 
Subgroups 

(a) order3: {1, a, a 2 }, {1, b, b 2 }, {1, ab, a 2 b 2 }, {1, a 2 6, a6 2 } 
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16. Cio, the cyclic group of order 10 

Generator: a with relation a 10 = 1 





1 


a 


a 2 


a 3 


a 4 


a 5 


a 6 


a 7 


a 8 


a 9 


1 


1 


a 


a 2 


a 3 


a 4 


a h 


a d 


a' 


a H 


a y 


a 


a 


a 2 


a 3 


a 4 


a 5 


a 6 


a 7 


a 8 


a 9 


1 


a 2 


a 2 


a 3 


a 4 


a 5 


a 6 


a 7 


a 8 


a 9 


1 


a 


a 3 


a 3 


a 4 


a 5 


a 6 


a 7 


a 8 


a 9 


1 


a 


a 2 


a 4 


a 4 


a 5 


a 6 


a 7 


a 8 


a 9 


1 


a 


a 2 


a 3 


a 5 


a 5 


a 6 


a 7 


a 8 


a 9 


1 


a 


a 2 


a 3 


a 4 


a 6 


a 6 


a 7 


a 8 


a 9 


1 


a 


a 2 


a 3 


a 4 


a 5 


a 7 


a 7 


a 8 


a 9 


1 


a 


a 2 


a 3 


a 4 


a 5 


a 6 


a 8 


a 8 


a 9 


1 


a 


a 2 


a 3 


a 4 


a 5 


a 6 


a 7 


a 9 


a 9 


1 


a 


a 2 


a 3 


a 4 


a 5 


a 6 


a 7 


a 8 



Elements 

(a) order 10: a, a 3 , a 7 , a 9 

(b) order 5: a 2 , a 4 , a 6 , a 8 

(c) order 2: a 5 

Subgroups 

(a) order 10: {l, a, a 2 , a 3 , a 4 , a 5 , a 6 , a 7 , a 8 , a 9 } 

(b) order5: {l, a 2 ,a 4 ,a 6 ,a 8 } 

(c) order 2: {l,a 5 } 

17. £)5, the dihedral group of order 10 



Generators: 


a, b with relations 
1 a a 2 


a 5 = 
a 3 


l,b 2 
a 4 


= 1, ba = a 
b ab 


a 2 b 


a 3 b 


a 4 b 


1 


1 


a 


a 2 


a 3 


a 4 


b 


ab 


a 2 b 


a 3 b 


a 4 b 


a 


a 


a 2 


a 3 


a 4 


1 


ab 


a 2 b 


a 3 b 


a 4 b 


b 


a 2 


a 2 


a 3 


a 4 


1 


a 


a 2 b 


a 3 b 


a 4 b 


b 


ab 


a 3 


a 3 


a 4 


1 


a 


a 2 


a 3 b 


a 4 b 


b 


ab 


a 2 b 


a 4 


a 4 


1 


a 


a 2 


a 3 


a 4 b 


b 


ab 


a 2 b 


a 3 b 


6 


b 


a 4 b 


a 3 b 


a 2 b 


ab 


1 


a 4 


a 3 


a 2 


a 


ab 


ab 


b 


a 4 b 


a 3 b 


a 2 b 


a 


1 


a 4 


a 3 


a 2 


a 2 b 


a 2 b 


ab 


b 


a 4 b 


a 3 b 


a 2 


a 


1 


a 4 


a 3 


a 3 b 


a 3 b 


a 2 b 


ab 


b 


a 4 b 


a 3 


a 2 


a 


1 


a 4 


a 4 b 


a 4 b 


a 3 b 


a 2 b 


ab 


b 


a 4 


a 3 


a 2 


a 


1 



Elements 



(a) order 5: a, a 2 , a 3 , a 4 

(b) order 2: b, ab, a 2 b, a 3 b, a 4 b 

Subgroups 

(a) order 10: {l, a, a 2 , a 3 , a 4 , b, ab, a 2 b, a 3 b, a 4 b) 

(b) order 5: {l, a, a 2 , a 3 , a 4 } 

(c) order 2: {1,6}, {l,ab} {l,a 2 6}, {l,a 3 6}, {l,a 4 b} 
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Normal subgroups 

(a) order 10: {l, a, a 2 , a 3 , a 4 , b, ab, a 2 b, a 3 b, a 4 b} 

(b) order 5: {l, a, a 2 , a 3 , a 4 } 

18. £>e, the dihedral group of order 12 

The multiplication table for D 6 (given below) 
Generators: a, b with relations a e = 1, b 2 = 1, ba = a~ L b 





1 


a 


a 2 


a 3 


a 4 


a 5 


b 


ab 


a 2 b 


a 3 b 


a 4 b 


a 5 b 


1 


1 


a 


a' 


a 3 


a 4 


a 5 


b 


ab 


a 2 b 


a 3 b 


a 4 b 


a 5 b 


a 


a 


a 2 


a 3 


a 4 


a 5 


1 


ab 


a 2 b 


a 3 b 


a 4 b 


a 5 b 


b 


a 2 


a 2 


a 3 


a 4 


a 5 


1 


a 


a 2 b 


a 3 b 


a 4 b 


a 5 b 


b 


ab 


a 3 


a 3 


a 4 


a 5 


1 


a 


a 2 


a 3 b 


a 4 b 


a 5 b 


b 


ab 


a 2 b 


a 4 


a 4 


a 5 


1 


a 


a 2 


a 3 


a 4 b 


a 5 b 


b 


ab 


a 2 b 


a 3 b 


a 5 


a 5 


1 


a 


a 2 


a 3 


a 4 


a 5 b 


b 


ab 


a 2 b 


a 3 b 


a 4 b 


b 


b 


a 5 b 


a 4 b 


a 3 b 


a 2 b 


ab 


1 


a 5 


a 4 


a 3 


a 2 


a 


ab 


ab 


b 


a 5 b 


a 4 b 


a 3 b 


a 2 b 


a 


1 


a 5 


a 4 


a 3 


a 2 


a 2 b 


a 2 b 


ab 


b 


a 5 b 


a 4 b 


a 3 b 


a 2 


a 


1 


a 5 


a 4 


a 3 


a 3 b 


a 3 b 


a 2 b 


ab 


b 


a 5 b 


a 4 b 


a 3 


a 2 


a 


1 


a 5 


a 4 


a A b 


a 4 b 


a 3 b 


a 2 b 


ab 


b 


a 5 b 


a 4 


a 3 


a 2 


a 


1 


a 5 


a 5 b 


a 5 b 


a 4 b 


a 3 b 


a 2 b 


ab 


b 


a 5 


a 4 


a 3 


a 2 


a 


1 



Elements 



(a) order 6: a, a 5 

(b) order 3: a 2 , a 4 

(c) order 2: a 3 , b, ab, a 2 b, a 3 b, a 4 b, a 5 b 
Subgroups 

(a) order 12: {l, a, a 2 , a 3 , a 4 , a 5 , b, ab, a 2 b, a 3 b, a 4 b, a 5 b} 

(b) order 6: {l, a, a 2 , a 3 , a 4 , a 5 } {l,a 2 ,a 4 ,b,a 2 b,a 4 b}, 
{l,a 2 ,a 4 ,ab,a 3 b,a 5 b} 

(c) order4: {l, a 3 , b, a 3 b), {l, a 3 , ab, a 4 b), {l, a 3 , a 2 b, a 5 b} 

(d) order 3: {l,a 2 ,a 4 } 

(e) order 2: {l, a 3 }, {1, b} , {1, ab}, {l, a 2 b}, { 1, a 3 b}, {l, a 4 b}, 
{l,a 5 b} 

Normal subgroups 

(a) order 12: {l,a,a 2 ,a 3 ,a 4 ,a 5 ,b,ab,a 2 b,a 3 b,a 4 b,a 5 b} 

(b) order6: {l, a, a 2 , a 3 , a 4 , a 5 }, {l, a 2 , a 4 , b, a 2 b, a 4 b), 
{l, a 2 ,a 4 ,ab, a 3 b, a 5 b} 

(c) order 3: {l, a 2 , a 4 } 

(d) order 2: {l,a 3 } 

Conjugacy classes: {!}, {a 3 }, {a, a 5 }, {a 2 , a 4 }, {b,a 2 b,a 4 b}, {ab,a 3 b,a 5 b} 
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19. Z 3 x Z4, the semidirect product of a cyclic group of order 4 acting on a 
cyclic group of order 3 (Note: x denotes the semidirect product.) 



Generators: a, b with relations a 6 = 1, b 2 = a 3 , ba = a l b 





1 


O 


a 2 


a 3 


a 4 


a 5 


b 


ab 


a 2 b 


a 3 b 


a 4 b 


a 5 b 


1 


1 


Cl 


a 2 


a 3 


a 4 


a 5 


b 


oh 


a 2 b 


a 3 b 


a 4 b 


a b b 





Cl 


a 2 


a 3 


a 4 


a 5 


1 


oh 


a 2 b 


a 3 b 


a 4 b 


a 5 b 


b 


a 2 


a 2 


a 3 


a 4 


a 5 


1 


a 


a 2 b 


a 3 b 


a 4 b 


a 5 b 


b 


ab 


a 3 


a 3 


a 4 


a 5 


1 


a 


a 2 


a 3 b 


a 4 b 


a 5 b 


b 


ab 


a 2 b 


a 4 


a 4 


a 5 


1 


a 


a 2 


a 3 


a 4 b 


a 5 b 


b 


ab 


a 2 b 


a 3 b 


a 5 


a 5 


1 


a 


a 2 


a 3 


a 4 


a 5 b 


b 


ab 


a 2 b 


a 3 b 


a 4 b 


b 


b 


a 5 b 


a 4 b 


a 3 b 


a 2 b 


ab 


a 3 


a 2 


a 


1 


a 5 


a 4 


ab 


ab 


b 


a 5 b 


a 4 b 


a 3 b 


a 2 b 


a 4 


a 3 


a 2 


a 


1 


a 5 


a 2 b 


a 2 b 


ab 


b 


a 5 b 


a 4 b 


a 3 b 


a 5 


a 4 


a 3 


a 2 


a 


1 


a 3 b 


a 3 b 


a 2 b 


ab 


b 


a 5 b 


a 4 b 


1 


a 5 


a 4 


a 3 


a 2 


a 


a A b 


a A b 


a 3 b 


a 2 b 


ab 


b 


a 5 b 


a 


1 


a 5 


a 4 


a 3 


a 2 


a 5 b 


a 5 b 


a 4 b 


a 3 b 


a 2 b 


ab 


b 


a 2 


a 


1 


a 5 


a 4 


a 3 



Elements 



(a) order 6: a, a 5 

(b) order 4: b, ab, a 2 b, a 3 b, a 4 b, a 5 b 

(c) order 3: a 2 , a 4 

(d) order 2: a 3 

Subgroups 

(a) order 12: {l, a, a 2 , a 3 , a 4 , a 5 , b, ab, a 2 b, a 3 b, a 4 b, a 5 b} 

(b) order 6: {l, a, a 2 , a 3 , a 4 , a 5 } 

(c) order4: {l, b, a 3 , a 3 b), {l, ab, a 3 , a 4 b), {l, a 2 b, a 3 , a 5 b} 

(d) order 3: {l,a 2 ,a 4 } 

(e) order 2: {l,a 3 } 

Normal subgroups 

(a) order 12: {l, a, a 2 , a 3 , a 4 , a 5 , b, ab, a 2 b, a 3 b, a 4 b, a 5 b] 

(b) order 6: {l, a, a 2 , a 3 , a 4 , a 5 } 

(c) order 3: {l, a 2 , a 4 } 

(d) order 2: {l,a 3 } 

Conjugacy classes: {1}, {a 3 }, {a, a 5 }, {a 2 , a 4 }, {b,a 2 b,a 4 b}, {ab,a 3 b,a 5 b} 

• Alternate representation, the group can be presented as follows, 
Generators: x, y with relations x 3 = 1, y 4 = 1, yx = x~ l y 
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1 


X 


X 2 


y 


xy 


9 

x y 


y 2 


9 

xy 


9 9 

x y 


y 3 


xy 3 


x 2 y 3 


1 


1 


X 


X 2 


y 


xy 


x 2 y 


y 2 


xy 2 


x 2 y 2 


y 3 


xy 3 


x 2 y 3 


X 


X 


x 2 


1 


xy 


9 

x y 


y 


9 

xy 


9 9 

x y 


y 2 


xy 3 


x 2 y 3 


y 3 


X 2 


X 2 


1 


X 


9 

x y 


y 


xy 


9 9 

x y 


y 2 


9 

xy 


x 2 y 3 


y 3 


xy 3 


y 


y 


2 

x y 


xy 


y 2 


9 9 

x y 


9 

xy 


y 3 


9 ^ 

x y 


xy 


1 


X 2 


X 


xy 


xy 


y 


x 2 y 


xy 2 


y 1 


x 2 y 2 


xy 3 


y 3 


x 2 y^ 


X 


1 


X 2 


9 

x y 


9 

x y 


xy 


y 


x 2 y 2 


xy 2 


y 2 


x 2 y 3 


xy 3 




X 2 


X 


1 


y 2 


y 2 


9 

xy 


9 9 

x y 


y 3 


xy 3 


x 2 y 3 


1 


X 


X 2 


y 


xy 


x 2 y 


xy 2 


xy 2 


x 2 y 2 


y 2 


xy 3 


x 2 y 3 


y 3 


X 


X 2 


1 


xy 


x 2 y 


y 


9 9 


9 9 

x y 


y 2 


xy 2 


x 2 y 3 


y 3 


xy 3 


X 2 


1 


X 


x 2 y 


y 


xy 


y 3 


y 3 


x 2 y 3 


xy 3 


1 


X 2 


X 


y 


x 2 y 


xy 


y 2 


9 9 

x y 


xy 2 


xy 3 


xy 3 


y 3 


x 2 y 3 


X 


1 


X 2 


xy 


y 


x 2 y 


xy 2 


y 2 


9 9 

x y 


x 2 y 3 


x 2 y 3 


xy 3 


y 3 


X 2 


X 


1 


x 2 y 


xy 


y 


9 9 

x y 


xy 2 


y 2 



Elements 

(a) order 6: x 2 y 2 ,xy 2 

(b) order 4: y, xy, x 2 y, y 3 , xy 3 , x 2 y 3 

(c) order 3: x,x 2 

(d) order 2: y 2 

Subgroups 

(a) order 12: {l, x, x 2 ,y,xy,x 2 y,y 2 , xy 2 ,x 2 y 2 ,y 3 ,xy 3 , x 2 y 3 } 

(b) order6: {l, x 2 y 2 , x,y 2 ,x 2 , xy 2 } 

(c) order4: {l,y,y 2 ,y 3 }, {l,xy,y 2 ,xy 3 }, {l,x 2 y,y 2 ,x 2 y 3 } 

(d) order 3: {l,x,x 2 } 

(e) order 2: {l,y 2 } 

Normal subgroups 

(a) order 12: {l, x, x 2 ,y,xy,x 2 y,y 2 , xy 2 ,x 2 y 2 ,y 3 ,xy 3 , x 2 y 3 } 

(b) order6: {l, x 2 y 2 , x,y 2 ,x 2 , xy 2 } 

(c) order 3: {l,x,x 2 } 

(d) order 2: {l,y 2 } 

Conjugacy classes: {1}, {y 2 }, {x,x 2 }, {xy 2 ,x 2 y 2 }, {y,xy,x 2 y}, 
{y 3 ,xy 3 ,x 2 y 3 } 

20. Ai, the alternating group on 4 elements 

Generators: a, b, c with relations a 2 = 1, b 2 = 1, c 3 = 1, ba = ab, ca = abc, 
cb = ac 





1 


a 


b 


ab 


c 


ac 


be 


abc 


c 2 


ac 2 


be 2 


abc 2 


1 


1 


a 


b 


ab 


c 


ac 


be 


abc 


c 2 


ac 2 


be 2 


abc 2 


a 


a 


1 


ab 


b 


ac 


c 


abc 


be 


ac 2 


c 2 


abc 2 


be 2 


b 


b 


ab 


1 


a 


be 


abc 


c 


ac 


be 2 


abc 2 


c 2 


ac 2 


ab 


ab 


b 


a 


1 


abc 


be 


ac 


c 


abc 2 


be 2 


ac 2 


c 2 


c 


c 


abc 


ac 


be 


c 2 


abc 2 


9 

ac 


be 2 


1 


ab 


a 


b 


ac 


ac 


be 


c 


abc 


ac 2 


be 2 


c 2 


abc 2 


a 


b 


1 


ab 


be 


be 


ac 


abc 


c 


be 2 


ac 2 


abc 2 


c 2 


b 


a 


ab 


1 


abc 


abc 


c 


be 


ac 


abc 2 


c 2 


be 2 


9 

ac 


ab 


1 


b 


a 


c 2 


c 2 


be 2 


abc 2 


ac 2 


1 


b 


ab 


a 


c 


be 


abc 


ac 






abc 2 


be 2 


c 2 


a 


ab 


b 


1 


ac 


abc 


be 


c 


be 2 


be 2 


c 2 


ac 2 


abc 2 


b 


1 


a 


ab 


be 


c 


ac 


abc 


abc 2 


abc 2 


ac 2 


c 2 


be 2 


ab 


a 


1 


b 


abc 


ac 


c 


be 
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Elements 



1. order 3: c, ac, be, abc, c 2 , ac 2 , be 2 , abc 2 

2. order 2: a, b, ab 

Subgroups 

1. order 12: \l,a,b,ab,c,ac,bc,abc,c 2 ,ac 2 ,bc 2 ,abc 2 } 

2. order 4: {1, a, b, ab} 

3. order 3: {l, c, c 2 }, {l, ac, be 2 }, { 1, be, abc 2 }, {l, abc, ac 2 } 

4. order 2: {l,a}, {1,6}, {l,ab} 

Normal subgroups 

1. order 12: \l,a,b,ab,c,ac,bc,abc,c 2 ,ac 2 ,bc 2 ,abc 2 } 

2. order 4: {1, a, b, ab} 

Conjugacy classes: {1}, {a,b,ab}, {c,ac,bc,abc}, {c 2 ,ac 2 ,bc 2 ,abc 2 } 

2.7.10.5 Small nite elds 

In the following, the entries under a 1 denote the coef cien t of powers of a. 
example, the last entry of the p(x) = x 3 + x 2 + 1 table is 1 1 0. That is: a 
la 2 + la 1 + 0a° modulo p(a), where the coef cien ts are taken modulo 2. 



q = A 


x 2 + x + 1 


i 


a* 





1 


1 


1 


2 


1 1 



q = 8 


x 3 + x + 1 




q = 8 


x 3 + x 2 + 1 


i 


a* 


i 


a* 





00 1 







00 1 


1 


1 




1 


1 


2 


100 




2 


100 


3 


1 1 




3 


1 1 


4 


1 1 




4 


1 1 1 


5 


1 1 1 




5 


1 1 


6 


1 1 




6 


1 1 



q = 16 


x 4 + X + 1 




q = 16 


x A + X 3 + 1 


i 


a 1 


7 


10 11 


i 


a 1 


7 


111 





000 1 


8 


10 1 







000 1 


8 


1110 


1 


00 10 


9 


10 10 




1 


00 10 


9 


10 1 


2 


100 


10 


111 




2 


100 


10 


10 10 


3 


1000 


11 


1110 




3 


1000 


11 


110 1 


4 


00 11 


12 


1111 




4 


100 1 


12 


00 11 


5 


110 


13 


110 1 




5 


10 11 


13 


110 


6 


1100 


14 


100 1 




6 


1111 


14 


1100 
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2.7.10.6 Addition and multiplication tables for F 2 , F 3 , F 4 , and Fg 

1 . F-2 addition and multiplication: 



+ 





1 







1 








1 











1 


1 





1 





1 



2. F3 addition and multiplication: 



+ 





1 


2 







1 


2 








1 


2 














1 


1 


2 





1 





1 


2 


2 


2 





1 


2 





2 


1 



3. F4 addition and multiplication 



+ 





1 


a 


a + 1 







1 


a 


a + 1 








1 


a 


a + 1 

















1 


1 





a + 1 


a 


1 





1 


a 


a + 1 


a 


a 


a + 1 





1 


a 





a 


a + 1 


1 


a + 1 


a + 1 


a 


1 





a + 1 





a + 1 


1 


a 



4. F 8 addition and multiplication (using strings of 0s and Is to represent the 
polynomials: = 000, 1 = 001, a = 010, a + 1 = 011, a 2 = 100, 
a 2 + a = 110, a 2 + 1 = 101, a 2 + a + 1 = 111): 



+ 


000 


001 


010 


011 


100 


101 


110 


111 


000 


000 


001 


010 


011 


100 


101 


110 


111 


001 


001 


000 


011 


010 


101 


100 


111 


110 


010 


010 


011 


000 


001 


110 


111 


100 


101 


011 


011 


010 


001 


000 


111 


110 


101 


100 


100 


100 


101 


110 


111 


000 


001 


010 


011 


101 


101 


100 


111 


110 


001 


000 


011 


010 


110 


110 


111 


100 


101 


010 


011 


000 


001 


111 


111 


110 


101 


100 


011 


010 


001 


000 




000 


001 


010 


011 


100 


101 


110 


111 


000 


000 


000 


000 


000 


000 


000 


000 


000 


001 


000 


001 


010 


011 


100 


101 


110 


111 


010 


000 


010 


100 


110 


011 


001 


111 


101 


011 


000 


011 


110 


101 


111 


100 


001 


010 


100 


000 


100 


011 


111 


110 


010 


101 


001 


101 


000 


101 


001 


100 


010 


111 


011 


110 


110 


000 


110 


111 


001 


101 


011 


010 


100 


111 


000 


111 


101 


010 


001 


110 


100 


011 
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2.7.10.7 Linear characters 

A linear character of a nite group G is a homomorphism from G to the multiplica- 
tive group of the non-zero complex numbers. Let % be a linear character of G, l the 
identity of G and g, h 6 G. Then 



X(i) = 1 

x(g *h)= x(g)x(h) 



x(g) 



for some integer k, where n is the order of g 



x(g J ) = x(g) 



The trivial character of G maps every element to 1. If \i an d Xi are two linear 
characters, then so is % = X\Xi de ned by xis) = Xi(g)X2(g)- In fact, the linear 
characters form a group. 



Group 



Characters 



G Abelian 



D„ dihedral 



Quaternions 



S n symmetric 



For m = 0, 1, . . . , n — 1, Xm ■ k i-> e 27rikm / n 

G = Z m x Z„ 2 x • • • x Z Mj . with each n,: a power of a prime. 
For rrij = 0,1, ... ,rij — 1 and <?j = (0, . . . , 0, 1, 0, . . . , 0) 

Arai,mj,...,m„ ■ J/j " e 

±1 if n even, 



For a; = ±1, y 



1 if n odd, 



a : o h-> h j/. (See de nitio n of D n .) 



For x ± 1 and y = ±1 or =pl 
1 
-1 



Xx,y 



h-> a;, 



-i 
i 



^ y 



The trivial character and sgn, where sgn is the signum function 
on permutations. (See Section 1.8.2.) 



2.7.10.8 List of all sporadic nite simple groups 

These are the sporadic nite simple groups that are not in any of the standard classes 
(see page 162). 



Group 


Order 


M u 


2 4 - 


3 2 


•5 11 


M12 


2 6 • 


3 3 


•5 11 


M 22 


2 7 - 


3 2 


• 5 • 7 • 11 


M 2Z 


2 7 - 


3 2 


•5 -7- 11 -23 


M 2i 


2 io 


•3 


5 -5 • 7 - 11 • 23 


Ji 


2 3 • 


3 • 


5 • 7 - 11 • 19 


h 


2 7 - 


3 3 


•5 2 -7 
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Group 


Order 




2 7 - 


3 5 • 


5 - 17- 19 




2 21 


•3 3 


• 5 • 7 • ll 3 • 23 • 29 • 31 • 37 • 43 


HS 


2 9 • 


3 2 • 


5 3 • 7- 11 


Mc 


2 7 - 


3 6 - 


5 3 • 11 


Suz 


2 13 


•3 7 


• 5 2 • 7 • 11 • 13 


Ru 


2 14 


•3 3 


• 5 3 • 7 • 13 • 29 


He 


2 io 


•3 3 


• 5 2 • 7 3 • 17 


Ly 


2 8 • 


3 7 - 


5 6 -7 - 11 -31 -37 - 67 


ON 


2 9 • 


3 4 - 


5 • 7 3 • 11 • 19 • 31 


.1 


2 21 


•3 9 


• 5 4 • 7 2 • 11 • 13 • 23 


.2 


2 18 


•3 6 


•5 3 - 7- 11 -23 


.3 


2 io 


•3 7 


•5 3 - 7- 11 -23 


M(22) 


2 17 


•3 9 


• 5 2 • 7 • 11 • 13 


M(23) 


2 18 


•3 13 


•5 2 • 7- 11 • 13 • 17 -23 


M(24)' 


2 21 


.glfl 


• 5 2 • 7 3 • 11 • 13 • 23 • 29 


^5 


2 15 


•3 1C 


• 5 3 • 7 2 • 13 • 19 • 31 


^3 


2 14 


•3 6 


• 5 6 • 7 • 11 • 19 


F 2 


2 41 


•3 13 


•5 6 • 7 2 • 11 • 13 • 17- 19 -23 • 31 -47 


Ft 


2 46 


•3 2C 


. 59 . 76 . U 2 . 13 3 . 17 . 19 . 23 • 29 • 31 • 41 • 47 • 59 • 71 



2.7.10.9 Indices and power residues 

For Z* the following table lists the index (order) of a and the power residues a, a 2 
1 for each element a, where (a, n) = 1. 



index(a) 



Group 


Element 


Index 


Power 
residues 


z; 


1 


1 


1 


Z3 


1 


1 


1 




2 


2 


2,1 


K 


1 


1 


1 




3 


2 


3,1 


z* 


1 


1 


1 




2 


4 


2,4,3,1 




3 


4 


3,4,2,1 




4 


2 


4,1 


z* 


1 


1 


1 




5 


2 


5,1 










z* 7 


1 


1 


1 




2 


3 


2,4,1 




3 


6 


3,2,6,4,5,1 




4 


3 


4,2,1 




5 


6 


5,4,6,2,3,1 




6 


2 


6,1 


z* 


1 


1 


1 




3 


2 


3,1 




5 


2 


5,1 




7 


2 


7,1 



Group 


Element 


Index 


Power 
residues 


K 


1 


1 


1 




2 


6 


2,4,8,7,5,1 




4 


3 


4,7,1 




5 


6 


5,7,8,4,2,1 




7 


3 


7,4,1 




8 


2 


8,1 


Zj 


1 


1 


1 




3 


4 


3,9,7,1 




7 


4 


7,9,3,1 




9 


2 


9,1 


Ki 


1 


1 


1 




2 


10 


2,4,8,5,10, 








9,7,3,6,1 




3 


5 


3,9,5,4,1 




4 


5 


4,5,9,3,1 




5 


5 


5,3,4,9,1 




6 


10 


6,3,7,9,10, 








5,8,4,2,1 




7 


10 


7,5,2,3,10, 








4,6,9,8,1 




8 


10 


8,9,6,4,10, 








3,2,5,7,1 




9 


5 


9,4,3,5,1 




10 


2 


10,1 
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2.7.10.10 Power residues in Z p 

For prime p < 40, the following table lists the minimal primitive root a and the 
power residues of a. These can be used to nd a m (mod p) for any (a, p) = 1. For 
example, to nd 3 7 (mod 11) (a = 3, m = 7), look in row p = 11 until the power 
of a that is equal to 3 is found. In this case 2 8 = 3 (mod 11). This means that 
3 7 = ( 2 8) 7 = 2 56 = (2 10 ) 5 • 2 6 = 2 6 = 9 (mod 11). 



p 


a 


Power residues 


J 


L 




.0 


.1 


.2 


.3 


.4 .5 


.6 


.7 


.8 


.9 




0. 


1 


2 


1 
















5 


2 




.0 


.1 


.2 


.3 


.4 .5 


.6 


.7 


.8 


.9 




0. 


1 


2 


4 


3 


1 












7 


3 




.0 


.1 


.2 


.3 


.4 .5 


.6 


.7 


.8 


.9 




0. 


1 


3 


2 


6 


4 5 


1 


















i 

. i 




•3 
.J 


.4 .5 


.6 


.7 


.8 


Q 




11 


2 


0. 
1. 


1 
1 


2 


4 


8 


5 10 


9 


7 


3 


6 










.0 


\ 


.2 


.3 


.4 .5 


.6 


7 . 


8 .9 




13 


2 


n 
u. 


1 
1 


Z 




Q 
O 


3 6 


12 


11 


Q ^ 










1 n 
1U 


1 


1 
1 






















n 
.U 


i 

.1 


.Z 


n 
.0 


.4 .5 .6 


.7 


o 

.0 


.y 


1 n 
i / 


-2 


u. 


1 
i 


?. 
J 


Q 


1 
1 u 


13 f 


5 15 


LI 


1 u 


A 






1 

1 . 


Q 
O 


1 


A 


1Z 


2 6 


1 














.0 


.i 


.2 


.3 


.4 


.5 


.6 


.7 


.8 


.9 


19 


2 


0. 


1 


2 


4 


8 


16 


13 


7 


14 


9 


18 






1. 


17 


15 


11 


3 


6 


12 


5 


10 


1 










.0 


.1 


.2 


.3 


.4 


.5 


.6 


.7 


.8 


.9 


23 




0. 


1 


5 


2 


10 


4 


20 


8 


17 


16 


11 


5 


1. 

2. 


9 
12 


22 
14 


18 
1 


21 


13 


19 


3 


15 


6 


7 








.0 


.1 


.2 


.3 


.4 


.5 


.6 


.7 


.8 


.9 


29 


2 


0. 


1 


2 


4 


8 


16 


3 


6 


12 


24 


19 




1. 


9 


18 


7 


14 


28 


27 


25 


21 


13 


26 






2. 


23 


17 


5 


10 


20 


11 


22 


15 


1 










.0 


.1 


.2 


.3 


.4 


.5 


.6 


.7 


.8 


.9 






0. 


1 


3 


9 


27 


19 


26 


16 


17 


20 


29 


31 


3 


1. 


25 


13 


8 


24 


10 


30 


28 


22 


4 


12 






2. 


5 


15 


14 


11 


2 


6 


18 


23 


7 


21 






3. 


1 


























.0 


.1 


.2 


.3 


.4 


.5 


.6 


.7 


.8 


.9 






0. 


1 


2 


4 


8 


16 


32 


27 


17 


34 


31 


37 


2 


1. 


25 


13 


26 


15 


30 


23 


9 


18 


36 


35 






2. 


33 


29 


21 


5 


10 


20 


3 


6 


12 


24 






3. 


11 


22 


7 


14 


28 


19 


1 
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2.7.10.1 1 Table of primitive monic polynomials 

In the table below, the elements in each string are the coef cients of the polynomial 
after the highest power of x. (For example, 564 represents x 3 + 5x 2 + 6x + 4.) 



Field 


Degree 


Primitive polynomials 


F 2 


1 







1 












2 




11 














3 




011 


101 












4 




0011 


1 nn 1 












j 




00101 


n i nn i 
U1UU1 


n i i i i 
Ul 1 1 1 


i ni i i 
1(J1 1 1 


1 i m i 
1 1U1 1 


111 ni 
1 1 1U1 




D 


000101 


n i 1 m 1 


1 nnnn i 
1UUUU1 


i nn i 1 1 
1UU1 1 1 


1 n i 1 n i 
1U1 1U1 


i i nn i i 
1 1UU1 1 


F 3 


1 







1 












2 




12 


22 












3 




021 


121 


201 


211 








4 




0012 


nnoo 
UV11 


1 nno 
1UUZ 


1 ill 


1 in 

illl 


onno 
1UU1 








2112 


1111 










F 5 


1 







2 


3 










2 




12 


23 


33 


42 








3 




032 


033 


042 


043 


102 


113 








143 


203 


213 


222 


223 


242 








302 


312 


322 


323 


343 


403 








412 


442 










F 7 


1 







2 


4 










2 




13 


23 


25 


35 


45 


53 








55 


63 












3 




032 


052 


062 


112 


124 


152 








154 


214 


242 


262 


264 


304 








314 


322 


334 


352 


354 


362 








422 


432 


434 


444 


504 


524 








532 


534 


542 


552 


564 


604 








612 


632 


644 


654 


662 


664 



2.7.10.12 Table of irreducible polynomials in 1-z[x\ 

Each polynomial is represented by its coef cients (which are either or 1), beginning 
with the highest power. For example, x 4 + x + 1 is represented as 10011. 



degree 1 


10 


11 










degree 2 


111 












degree 3 


1011 


1101 










degree 4 


10011 


11001 


11111 








degree 5 


100101 


101001 


101111 


110111 


111011 


111101 


degree 6 


1000011 


1001001 


1010111 


1011011 


1100001 


1100111 




1101101 


1110011 


1110101 








degree 7: 10000011 


10001001 


10001111 


10010001 


10011101 


10100111 




10101011 


10111001 


10111111 


11000001 


11001011 


11010011 




11010101 


11100101 


11101111 


11110001 


11110111 


11111101 


degree 8 


100011011 


100011101 


100101011 


100101101 


100111001 


100111111 




101001101 


101011111 


101100011 


101100101 


101101001 


101110001 




101110111 


101111011 


110000111 


110001011 


110001101 


110011111 




110100011 


110101001 


110110001 


110111101 


111000011 


111001111 




111010111 


111011101 


111100111 


111110011 


111110101 


111111001 
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2.7.10.13 Table of primitive roots 

The number of integers not exceeding and relatively prime to the integer n is <f>(n) 
(see page 128). These integers form a group under multiplication module n; the 
group is cyclic if, and only if, n = 1, 2, 4 or n is of the form p k or 2p k , where p is 
an odd prime. The number g is a primitive root of n if it generates that group, i.e., if 
{g,g 2 , g^™) } are distinct modulo n. There are <f>(<f>(n)) primitive roots of n. 

1. If g is a primitive root of p and g v ~ l ^ 1 (mod p 2 ), then g is a primitive root 
of p k for all k. 

2. If g p_1 = 1 (mod p 2 ) then g + p is a primitive root of for all k. 

3. If g is a primitive root of p k , then either g or g + p k , whichever is odd, is a 
primitive root of 2p k . 

4. If g is a primitive root of n, then g k is a primitive root of n if, and only if, k 
and ^(n) are relatively prime, i.e., ((f>(n),k) = 1. 

In the following table, 

• g denotes the least primitive root of p 

• G denotes the least negative primitive root of p 

• e denotes whether 10, —10, or both, are primitive roots of p 



V 


V 


- 1 


9 


G 


e 


V 


p-1 


9 


G 


e 


3 


2 




2 


-1 




5 


2 2 




2 


-2 




7 


2 ■ 


3 


3 


-2 


10 


11 


2 • 


5 


2 


-3 




13 


2 2 


■ 3 


2 


-2 




17 


2 4 




3 


-3 


±10 


19 


2 ■ 


3 2 


2 


-4 


10 


23 


2 • 


11 


5 


-2 


10 


29 


2 2 


■ 7 


2 


-2 


±10 


31 


2 • 


3 • 5 


3 


-7 


-10 


37 


2 2 


•3 2 


2 


-2 




41 


2 3 


• 5 


6 


-6 




43 


2 ■ 


3 • 7 


3 


-9 


-10 


47 


2 ■ 


23 


5 


-2 


10 


53 


2 2 


• 13 


2 


-2 




59 


2 ■ 


29 


2 


-3 


10 


61 


2 2 


•3-5 


2 


-2 


±10 


67 


2 ■ 


3 • 11 


2 


-4 


-10 


71 


2 • 


5 • 7 


7 


-2 


-10 


73 


2 3 


•3 2 


5 


-5 




79 


2 ■ 


3 • 13 


3 


-2 




83 


2 • 


41 


2 


-3 


-10 


89 


2 3 


• 11 


3 


-3 




97 


2 6 


• 3 


5 


-5 


±10 


101 


2 2 


•5 2 


2 


-2 




103 


2 ■ 


3 • 17 


5 


-2 




107 


2 • 


53 


2 


-3 


-10 


109 


2 2 


•3 3 


6 


-6 


±10 


113 


2 4 


• 7 


3 


-3 


±10 


127 


2 • 


3 2 • 7 


3 


-9 




131 


2 • 


5 • 13 


2 


-3 


10 


137 


2 3 


• 17 


3 


-3 




139 


2 • 


3 • 23 


2 


-4 




149 


2 2 


• 37 


2 


-2 


±10 


151 


2 • 


3 • 5 2 


6 


-5 


-10 


157 


2 2 


•3-13 


5 


-5 




163 


2 ■ 


3 4 


2 


-4 


-10 


167 


2 ■ 


83 


5 


-2 


10 
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2.7.1 0.1 4 Table of factorizations of x n - 1 



n Factorization of x™ — 1 mod 2 

1 -1+x 

2 (-l + x)(l + x) 

3 (-1 + x) (l + x + x 2 ) 

4 (-1 + x) (1 + x) (1 + x 2 ) 

5 (-1 + x) (l + x + x 2 +x 3 +x 4 ) 

6 (-1 + x) (1 + x) (l - x + x 2 ) (l + x + x 2 ) 

7 (-1 + x) (1 + x + x 2 +x 3 +x A +x 5 + x 6 ) 

8 (-1 + x) (1 + x) (1 + x 2 ) (1 + x 4 ) 

9 (-1 + x) (1 + x + x 2 ) (1 + x 3 + x 6 ) 

10 (-1 + x) (1 + x) (l-x + x 2 - x 3 + x A ) (l + x + x 2 +x 3 + x A ) 

11 (-1 + x) (l + x + x 2 + X 3 + X A + X 5 + X 6 + X 7 + X S + X 9 + x 10 ) 

12 (-1 + x) (1 + x) (1 + x 2 ) (1 - x + x 2 ) (l + x + x 2 ) (1 - x 2 + x A ) 

13 (-1 + x) (Ello* k ) 

14 (-1 + x) (1 + x) (1 - x + x 2 - x 3 + x A - x 5 + x 6 ) 

(1 + X + x 2 + X 3 + x A + X 5 + X 6 ) 

15 (-1 + x) (l + x + x 2 ) (l + x + x 2 +x 3 +x A ) 
(l - X + x 3 - x A + x 5 - X 7 + X 8 ) 

16 (-1 + x) (1 + x) (1 + x 2 ) (1 +x A ) (1 +x 8 ) 

17 (-l + a 0(£i fl = o**) 

18 (-1 + x) (1 + x) (l-x + x 2 ) (l + x + x 2 ) (1 - x 3 + x 6 ) (1 + x 3 + x 6 ) 

19 (-1 + x) (EjLo**) 

20 (-1 + x)(l + x) (1 + x 2 ) (l-x + x 2 -x 3 + x A ) 
(l + x + x 2 +x 3 + x A ) (1 - x 2 + x A - X 6 + x s ) 

21 (-1 + x) (l + x + x 2 ) (1 + x + x 2 + x 3 + x A + x 5 + x 6 ) 
(1 - x + x 3 - x A + x 6 - x s + x 9 - x 11 + x 12 ) 

22 (-1 + x) (1 - x + x 2 - x 3 + x A - x 5 + x 6 - x 7 + x s - x 9 + x 10 ) 
(1 + x) (1 + X + x 2 + X 3 + x A + X 5 + X 6 + X 7 + X S + X 9 + x 10 ) 

23 (-1 + *) (£* 2 =o**) 

24 (-1 + x)(l + x) (1 + x 2 ) (l-x + x 2 ) (l + x + x 2 ) (1 + x A ) 
(1 -x 2 +x A ) (1 -x A +x 8 ) 

25 (-1 + x) (l + x + x 2 +x 3 + x A ) (1 + x 5 + x 10 + x 15 + x 20 ) 

26 (-1 + x) (1 + x) 

(1 - X + x 2 - x 3 + x A - X 5 + x 6 - X 7 + x s - x 9 + x 10 - x 11 + x 12 ) 
(1 + X + x 2 + X 3 + x 4 + X 5 + X 6 + X 7 + X 8 + X 9 + x 10 + x 11 + x 12 ) 

27 (-1 + x) (l + x + x 2 ) (1 + x 3 +x 6 ) (1 + x 9 +x 18 ) 

28 (-1 + x) (1 + x) (1 + x 2 ) (1 - x + x 2 - x 3 + x 4 - x 5 + x 6 ) 

(1 + X + x 2 + X 3 + x 4 + X 5 + x 6 ) (1 - x 2 + x 4 - X 6 + x 8 - x 10 + x 12 ) 

29 (-1 + x) (£* 8 =o**) 

30 (-1 + x) (1 + x) (l-x + x 2 ) (1 + x + x 2 ) (1 - x + x 2 - x 3 + x 4 ) 
(1 + X + x 2 + X 3 + x 4 ) (1 - X + x 3 - x 4 + x 5 - X 7 + X 8 ) 

(l + x - x 3 - x 4 - X 5 + X 7 + X 8 ) 
32 (-1 + x) (1 + x) (1 + x 2 ) (1 + x 4 ) (1 + x 8 ) (1 + x 16 ) 
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(a) cyclic subgroup generated by a .162 
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(r,s,w) type of tensor 483 

(v, k, A) design nomenclature . 245 
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coordinates 348 
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{iv) fourth derivative 386 
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** crystallographic group 309 
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group operation 161 
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product 66 
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asymptotic function 75 

ohm 792 



© 2003 by CRC Press LLC 



$(x) normal distribution function . . .634 

asymptotic function 75 

T (G) graph arboricity 220 

a 

a(G) graph independence number 
225 

a(k) function, related to zeta 

function 23 

one minus the con dence 

coef cient 666 

probability of type I error 661 

P 

j3 probability of type II error . . 661 
j3(k) function, related to zeta 

function 23 

X 

x'{G) chromatic index 221 

x(G) chromatic number 221 

X 2 -distribution 703 

Xa critical value 696 

Xn chi-square distributed 619 

5 

5(G) minimum vertex degree . .223 

S(x) delta function 76 

Si j Kronecker delta 483 

designed distance 257 

Feigenbaum's constant 272 

ejj Levi-Civita symbol 489 

V 

r) power of a test 661 

rj(x, y) component of in nitesimal 
generator 466 

7 

7 Euler's constant 

de nition 15 

in different bases 16 

value 16 

7(G) graph genus 224 

j(k) function, related to zeta 

function 23 

71 skewness 620 

72 excess 620 

K 

k(G) connectivity 222 

k(s) curvature 374 

K n cumulant 620 

A 

A(G) edge connectivity 223 

average arrival rate 638 

eigenvalue 152, 477, 478 

number of blocks 24 1 



fj.(n) Mobius function 102 

p k centered moments 620 

f/ k moments 620 

Hp MTBF for parallel system . . 655 
fi s MTBF for series system . . . 655 

average service rate 638 

mean 620 

v 

T>(G) rectilinear graph crossing 

number 222 

v(G) graph crossing number . . 222 
u>(G) size of the largest clique 221 

4> 

<j>{n) totient function 128, 169 

<j>(t) characteristic function . . . .620 

Euler constant 21 

golden ratio 

de ned 16 

value 16 

incidence mapping 219 

zenith 346 

7T 

■k(x) 

prime counting function .... 103 

probability distribution 640 

constants containing 14 

continued fraction 97 

distribution of digits 15 

identities 14 

number 13 

in different bases 16 

permutation 172 

sums involving 24 

ip{z) logarithmic derivative of the 

gamma function 543 

P 

p(A) spectral radius 154 

p(s) radius of curvature 374 

pij correlation coef cient 622 

server utilization 638 

a 

a standard deviation 620 

a(n) sum of divisors 128 

<t 2 variance 620 

<Ti singular value of a matrix . . 152 
(Tk (n) sum of k tb powers of divisors 
128 

an variance 622 

<Tij covariance 622 
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T 

t Ramanujan function 31 

r(n) number of divisors 128 

r(s) torsion 374 

e 

8(G) graph thickness 227 

angle in polar coordinates 302 

argument of a complex number . 53 
azimuth 346 

a 

£(x, y) component of in nitesimal 

generator 466 

£ p quantile of order p 659 

C(k) Riemann zeta function 23 

Numbers 

group inverse 161 

matrix inverse 138 

null vector 137 

1 

1, group identity 161 

1- form 395 

10, powers of 6, 13, 798 

105 D standard 652 

16, powers of 12 

17 crystallographic groups 307 

2 

2 A power set of A 203 

2*22 crystallographic group ... 310 

2, negative powers of 10 

2, powers of 6, 10, 27 

2- (w,3,l) Steiner triple system . 249 

2-form 396 

2-sphere 491 

2- switch 227 

22* crystallographic group .... 309 

22 x crystallographic group 309 

2222 crystallographic group ...310 
230 crystallographic groups, 

three-dimensional 307 

3 

3*3 crystallographic group .... 311 

3, powers of 29 

3- design (Hadamard matrices) . 250 

3-form 397 

3-sphere 491 

333 crystallographic group .... 31 1 
360, degrees in a circle 503 



4 

4*2 crystallographic group .... 310 

4, powers of 30 

442 crystallographic group 310 

5 

5, powers of 30 

5-(12,6,l) table 244 

5-design, Mathieu 244 

632 crystallographic group 311 

Roman Letters 



A interarrival time 637 

A(n, d) number of codewords . 259 
A(T) skew symmetric part of a 

tensor 484 

A ampere 792 

A () 

A4 alternating group on 4 elements 
188 

A k radius of circumscribed circle 
324 

A n alternating group 163, 172 

A/B/c/K/m/Z queue 637 

Ai(z) Airy function 465, 565 

ALFS additive lagged-Fibonacci 

sequence 646 

AMS American Mathematical Society 

801 

ANOVA analysis of variance 686 

AOQ average outgoing quality 652 

AOQL average outgoing quality limit 652 

AQL acceptable quality level 652 

AR(fc) autoregressive model 718 

ARMA(&, /) mixed model 719 

Aut(G) graph automorphism group .220 

«() 

&i unit vector 492 

a n Fourier coef cients 48 

a n proportion of customers 637 

a.e. almost everywhere 74 

am amplitude 572 

arg argument 53 
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B 

B 

B amount borrowed 779 

B service time 637 

B(p, q) beta function 544 

B set of blocks 241 

B() 

B n Bell number 211 

B n Bernoulli number 19 

B n a block 241 

B n (x) Bernoulli polynomial ... 19 

B. C.E (before the common era, B.C.) 810 

BFS basic feasible solution 283 

Bi(«) Airy function 465, 565 

BIBD balanced incomplete block design 

245 

Bq becquerel 792 

b unit binormal vector 374 

c 

c 

C channel capacity 255 

C(n, r) r-combination . . . 206, 215 

C(x) Fresnel integral 547 

C R (n, r) combinations with 

replacement 206 

C complex numbers 3, 167 

C" complex n element vectors 131 

C integration contour 399, 404 

C coulomb 792 

C Roman numeral (100) 4 

Co 

C2 cyclic group of order 2 178 

Ci x Ci x Ci direct group product 
181 

C3 cyclic group of order 3 .... 178 
C3 x C3 direct group product . 184 

C4 cyclic group of order 4 178 

C4 x Ci direct group product .181 
C5 cyclic group of order 5 .... 179 
Ce cyclic group of order 6 .... 179 

C-i cyclic group of order 7 180 

Cg cyclic group of order 8 180 

Cg cyclic group of order 9 .... 184 

C n Catalan numbers 212 

C n cycle graph 229 

C n cyclic group 172 

C10 cyclic group of order 10 . . 185 

C. E. (common era, A.D.) 810 

Ci(z) cosine integral 549 



c 

c cardinality of real numbers . . 204 
c number of identical servers . . 637 

c speed of light 794 

cas combination of sin and cos 591 

cd candela 792 

cm crystallographic group 309 

cmm cry stallographic group 310 

c n Fourier coef cients 50 

cn(ii, k) elliptic function 572 

cofjj (A) cofactor of matrix A 145 

cond(A) condition number 148 

cos trigonometric function 505 

cosh hyperbolic function 524 

cot trigonometric function 505 

coth hyperbolic function 524 

covers trigonometric function 505 

esc trigonometric function 505 

csch hyperbolic function 524 

eye number of cycles 172 

D 

D 

D constant service time 637 

D diagonal matrix 138 

D differentiation operator 456, 466 
D Roman numeral (500) 4 

A) 

D4 dihedral group of order 8 . . 182 
Df, dihedral group of order 10 .185 
D e dihedral group of order 12 .186 

D f region of convergence 595 

D n derangement 210 

D n dihedral group 163, 172 

DFT discrete Fourier transform 582 

DLG(n; a, b) double loop graph 230 

d 

d(u, v) distance between vertices 
223 

derivative operator 386 

exterior derivative 397 

minimum distance 256 

d {) 

d n proportion of customers .... 637 
dn(u, v) Hamming distance . . . 256 

dxk(a) projection 395 

det(A) determinant of matrix A 144 

diam(G) graph diameter 223 

div divergence 493 

dn(ii, k) elliptic function 572 
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dS differential surface area 405 

dV differential volume 405 

dx fundamental differential 377 

E 

E 

Sedge set 219 

E event 617 

E(u, v) rst fundamental metric 

coef cient 377 

E [ ] expectation operator 619 

E() 

E k Erlang-fc service time 637 

E n Euler numbers 20 

E n (x) Euler polynomial 20 

E n (x) exponential integral 550 

E p identity group 172 

Eij elementary matrix 138 

Ei exbi 6 

e 

e algebraic identity 161 

e charge of electron 794 

e constants containing 15 

e continued fraction 97 

e de nition 15 

e eccentricity 325 

e in different bases 16 

e(u, v) second fundamental metric 
coef cient 377 

e () 

e vector of ones 137 

ei unit vector 137 

ei 1 ...i n permutation symbol ...489 

ecc(w) eccentricity of a vertex 223 

erf error function 545 

erfc complementary error function . . 545 
exsec trigonometric function 505 

F 

F 

F(u, v) rst fundamental metric 

coef cient 377 

F(x) Dawson's integral 546 

F(x) probability distribution 

function 619 

T Fourier transform 576 

F (a, b; c; z) hypergeometric 

function 553 



F{x) sample distribution function 
658 



F farad 792 

F n Fibonacci numbers 21 

F a critical value 696 

F p n Galois eld 169 

F c Fourier cosine transform ... 582 

F s Fourier sine transform 582 

Fn discrete Fourier transform . 582 
p F q hypergeometric function ... 36 

FCFS rst come, rst served 637 

FFT fast Fourier transform 584 

FIFO rst in, rst out 637 

f 

f(x) sample density function . .658 
f(u, v) second fundamental metric 

coef cient 377 

f(x) probability density function 

619 

fx(t) density function 467 

G 

G 

G Green's function 471 

G general service time distribution 
637 

G generating matrix 256 

G graph 219 

G gravitational constant 794 

G primitive root 195 

G(k) Waring's problem 100 

G(s) generating function 620 

G(u, v) rst fundamental metric 

coef cient 377 

G(x; z) Green's function 463 

G[x n ] generating function 268 

G Catalan constant 23 

Gn,m isomorphism classes .... 241 

GCD greatest common divisor 101 

GF(p n ) Galois eld 169 

GI general interarrival time 637 

Gi gibi 6 

GL(n, C) matrix group 171 

GL(n, ffi) matrix group 171 

G.M. geometric mean 659 

Gygray 792 

gir(()G) graph girth 224 

g 

g determinant of the metric tensor 
489 

g metric tensor 487 
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g primitive root 195 

g(k) Waring 's problem 100 

g(x) generating polynomial . . . 256 

gd function 530 

gd x Gudermannian function 530 

g' J covariant metric 486 

gij contravariant metric 486 

gib greatest lower bound 68 

H 

H 

H mean curvature 377 

H parity check matrix 256 

H(p x ) entropy 253 

H (x) Haar wavelet 723 

H (x) Heaviside function . . 77, 408 

U Hubert transform 591 

H Hermitian conjugate 138 

H henry 792 

H null hypothesis 661 

Hi alternative hypothesis 661 

Hankel function 559 

Hi 2) Hankel function 559 

Hk ft-stage hyperexponential 

service time 637 

H n harmonic numbers 32 

H n (x) Hermite polynomials . . 532 

T-L v Hankel transform 589 

H.M. harmonic mean 660 

Hz hertz 792 

hav trigonometric function 372, 505 

hi metric coef cients 492 

I 

I 

I rst fundamental form 377 

/ identity matrix 138 

I(X, Y) mutual information . . 254 

I Roman numeral (1) 4 

ICG inversive congruential generator 646 

II second fundamental form 377 

Im imaginary part of a complex number 
53 

identity matrix 138 

Inv number of invariant elements . . . 172 
IVP initial-value problem 265 



l 

i unit vector 494 

i unit vector 135 

i imaginary unit 53 

i interest rate 779 

iid independent and identically 

distributed 619 

inf greatest lower bound 68 

in mum greatest lower bound 68 

J 

J 

J Jordan form 154 

J joule 792 

j 

j unit vector 494 

j unit vector 135 

J„ (z) Bessel function 559 

J c Julia set 273 

h) 

j n (z) half order Bessel function 
563 

j„,fe zero of Bessel function . . . 563 

K 

K 

K Gaussian curvature 377 

K system capacity 637 

K Kelvin (degrees) 792 

K n complete graph 229 

K m , n complete bipartite graph 230 
K ni ,...,n h complete multipartite 

graph 230 

K n empty graph 229 

Ki kibi 6 

k 

k curvature vector 374 

k unit vector 494 

k unit vector 135 

k Boltzmann constant 794 

k dimension of a code 258 

k(x,t) kernel 478 

kg geodesic curvature 377 

k n normal curvature vector .... 377 

kj block size 241 

kg kilogram 792 
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L 

L 

L average number of customers 638 

L period 48 

L(8) expected loss function . . . 656 

£ Laplace transform 585 

L length 796 

L Roman numeral (50) 4 

L\ norm 133 

Z/2 norm 133 

Lq average number of customers 
638 

L p norm 73 

L r Lie group 466 

Loo space of measurable functions 
73 

LCG linear congruential generator . . 644 

LCL lower control limit 650 

LCM least common multiple 101 

Lii (z) logarithm 551 

Li 2 (z) dilogarithm 551 

LIFO last in, rst out 637 

Li n (z) polylogarifhm 551 

li(a;) logarithmic integral 550 

LP linear programming 280 

LTPD lot tolerance percent defective 652 

1(8, a) loss function 656 

lim limits 70, 385 

liminf limit inferior 70 

limsup limit superior 70 

lm lumen 792 

In logarithmic function 522 

log logarithmic function 522 

log 6 logarithm to base b 522 

lub least upper bound 68 

lux lux 792 

M 

M 

M Mandelbrot set 273 

M exponential service time . . . 637 

M number of codewords 258 

M(P) measure of a polynomial 93 

M Mellin transform 612 

M mass 796 

M Roman numeral (1000) 4 

MA (2) moving average 719 

M.D. mean deviation 660 



MFLG multiplicative lagged-Fibonacci 

generator 646 

M/G/l queue 639 

M/G/c/c queue 639 

M/G/oo queue 639 

Mi mebi 6 

MLE maximum likelihood estimator 662 

M/M/l queue 638 

M/M/c queue 639 

M n Mobius ladder graph 229 

MOLS mutually orthogonal Latin 

squares 251 

MOM method of moments 662 

MTBF mean time between failures . . 655 
m 

m mortgage amount 779 

m number in the source 637 

m meter 792 

mid midrange 660 

mod modular arithmetic 94 

mol mole 792 

N 

N 

N number of zeros 58 

N(A) null space 149 

N(p, a) normal random variable 
619 

N unit normal vector 378 

jV normal vector 377 

N natural numbers 3 

N newton 792 

N q (n) number of monic irreducible 

polynomials 261 

n 

n principal normal unit vector . 374 

n unit normal vector 135 

n code length 258 

n number of time periods 779 

n order of a plane 248 

o 

O asymptotic function 75 

0(n) matrix group 171 

O n odd graph 229 

o asymptotic function 75 
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p 

P number of poles 58 

P principal 779 

P(B | A) conditional probability 
617 

P(E) probability of event E . . 617 

P(i>,z) auxiliary function 561 

P(m,r) r-permutation 215 

P(n, r) r-permutation 206 

P{x,y) Markov transition function 
640 

P{ } Riemann P function 465 

Pa 

Pg(x) chromatic polynomial . .221 

P n path (type of graph) 229 

P n (x) Lagrange interpolating 

polynomial 733 

P n (x) Legendre function 465 

P n (x) Legendre polynomials . . 534 
P n a,l3 \x) Jacobi polynomials .533 

P v {z) Legendre function 554 

P$ (x) associated Legendre 

functions 557 

Pa pascal 792 

Per(xn) period of a sequence 644 

Pi pebi 6 

PID principal ideal domain 165 

P n (x, y) n-step Markov transition 

matrix 641 

P R (n, r) permutations with replacement 
206 

PRI priority service 637 

PRNG pseudorandom number generator 
644 

P 

p(n) partitions 210 

p# product of prime numbers . 106 

pi crystallographic group 309, 311 

p2 cry stallographic group 310 

p3 crystallographic group 311 

p31m crystallographic group 311 

p3ml crystallographic group 311 

p4 crystallographic group 310 

p4g crystallographic group 310 

p4m crystallographic group 310 

p6 crystallographic group 311 

p6m crystallographic group 311 
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pg crystallographic group 309 



pgg crystallographic group 309 

pm crystallographic group 309 

pmg crystallographic group 309 

pmm crystallographic group 310 

P() 

Pxxy j° mt probability distribution 
254 

Pk discrete probability 619 

Pk (n) partitions 207 

Pm(n) restricted partitions 210 

p n proportion of time 638 

Q 

Q 

Q quaternion group 182 

Q(v,z) auxiliary function 561 

Q rational numbers 3, 167 

Qo 

Q n cube (type of graph) 229 

Q n (x) Legendre function 465 

Q„ (z) Legendre function 554 

Qt (x) associated Legendre functions 
557 

q nome 574 

R 

R 

R Ricci tensor 485,488 

R Riemann tensor 488 

R curvature tensor 485 

R radius (circumscribed circle) 319, 
513 

R range 650 

R rate of a code 255 

R(A) range space 149 

R(8,di) risk function 657 

R(t) reliability function 655 

K continuity in 71 

M. convergence in 70 

ffi real numbers 3, 167 

R () 

Ri reliability of a component . . 653 
R p reliability of parallel system 653 
R s reliability of series system . 653 

i?0 radius of the earth 372 

IK" real n element vectors 131 

R nxm real nxm matrices 137 

Re real part of a complex number .... 53 
R.M.S. root mean square 660 
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RSS random service 637 

r 

r distance in polar coordinates . 302 
r modulus of a complex number 53 
r radius (inscribed circle) .318,512 



r shearing factor 352 

r(6, a) regret function 658 

rad(()G) radius of graph 226 

rad radian 792 

n replication number 241 

tk (x) Rademacher functions 722 

s 

s 

S sample space 617 

S torsion tensor 485 

S(x) Fresnel integral 547 

S n symmetric group 163 

S(n, k) Stirling number second 

kind 213 

iS(T) symmetric part of a tensor 

484 

S siemen 792 

S() 

S3 symmetric group 180 

Sk area of inscribed polygon . . 324 

S n star (type of graph) 229 

S n symmetric group 172 

S n (r) surface area of a sphere . 368 

S A simulated annealing 291 

SI Systeme Internationale d'Unites . .792 

Si(z) sine integral 549 

SL(n, C) matrix group 171 

SL(n, ffi) matrix group 171 

SO{2) matrix group 172 

SO(n) matrix group 172 

SPRT sequential probability ratio test 681 

SRS shift-register sequence 645 

STS Steiner triple system 249 

SU(n) matrix group 172 

SVD singular value decomposition . . 156 
s 



s(n,k) Stirling number rst kind 



213 

s arc length parameter 373 

s sample standard deviation . . . 660 

s semi-perimeter 512 

s second 792 



s () 

Sk area of circumscribed polygon 
324 

Sk elementary symmetric functions 



84 

sec trigonometric function 505 

sech hyperbolic function 524 

sgn signum function 77, 144 

sin trigonometric function 505 

sinh hyperbolic function 524 

sn(u, k) elliptic function 572 

sr steradian 792 

sup least upper bound 68 

supremum least upper bound 68 

T 

T 

T transpose 131 

Ttesla 792 

T time interval 796 

transpose 138 

T() 

T n (x) Chebyshev polynomials 534 



T n ,m isomorphism class of trees 



241 

Ti tebi 6 

TN(w, s) Toeplitz network 230 

tr(A) trace of matrix A 150 

t-(v, k, A) design nomenclature 241 

*() 

t a critical value 695 

t x , y transition probabilities 255 

tan trigonometric function 505 

tanh hyperbolic function 524 

t unit tangent vector 374 

u 

u 

U universe 201 

U(n) matrix group 172 

U[a, b) uniform random variable 
619 

U n (x) Chebyshev polynomials 535 

UCL upper control limit 650 

UFD unique factorization domain ... 165 

UMVU type of estimator 663 

URL Uniform Resource Locators . . . 803 

u traf c intensity 638 

u(n) unit step function 595 

m distance 492 
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V 



Y 



v 

V Klein four group 179 

V vertex set 219 

V Roman numeral (5) 4 

Vvolt 792 

Vec vector operation 158 

V„ (r) volume of a sphere 368 

vers trigonometric function 505 

w 

w 

W average time 638 

W(u, v) Wronskian 462 

Wwatt 792 

Wn root of unity 582 

Wq average time 638 

W n wheel (type of graph) 229 

W n {x) Walsh functions 722 

Wb weber 792 

X 

x 

X in nitesimal generator 466 

X set of points 241 

X Roman numeral (10) 4 

X^ rst prolongation 466 

X (2) second prolongation 466 

X(i) i th order statistic 659 

Xi rectangular coordinates 492 



Y v (z) Bessel function 559 

yh (x) homogeneous solution . . 456 
y n (z) half order Bessel function 



563 

y p (x) particular solution 456 

y v ,k zero of Bessel function . . . 563 

Z 

Z 

Z queue discipline 637 

Z(G) center of a graph 221 

Z(t) instantaneous hazard rate .655 

Z integers 3, 167 

Z Z-transform 594 

Z() 

Z 3 x Zn semidirect group product 
187 

Z n integers modulo n 167 

lT n a group 163 

Z p integers modulo p 167 

z complex number 53 

z a critical value 695 
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